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I. INTRODUCTION 


In image processing applications, motion arises from a 
relative displacement between the video camera and the image 
being observed. The displacement can result from _ two 
situations, either the video camera or viewing platform is in 
motion (which gives the appearance that all objects or 
features within the image are moving), or the camera is 
stationary and the displacement is caused by the movement of 
an object. Although the video tracking algorithms developed 
concentrate primarily on the latter situation, application to 
the case of a moving platform is also investigated. 

Tracking of objects and image features from video signals 
has applications in various areas of robotics, visual 
guidance systems, anti-aircraft weapons firing systems, and 
autonomous navigation, to name a few. Most of the algorithms 
available in the literature are designed to track a desired 
object based on its edges. Although the edge detection 
operation is well known, the implementation of using local 
operators (Sobel, Roberts, Laplacian) (Ref. 1) is 
computationally inefficient, since it uses the intensity 
level of each pixel several times. Therefore, applications 
based on off-the-shelf microcomputers require more efficient 
algorithms for real-time implementation. 

In this thesis we developed a tracking algorithm 
operating on video signals in real-time, capable of following 
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objects moving on smooth trajectories. The edge detection 
technique which separates the objects from the background is 
based on a variation of the basic Kalman filter which detects 
changes in the signal model. The efficient use of lookup 
tables for the Kalman filter gains makes this algorithm 
attractive for real-time implementation. 

The image processing system used to implement’ the 
developed tracking algorithms is based on an IBM AT Personal 
Computer.1 A PCVISIONplus FRAMEGRABBER2 board is installed 
in the computer which allows the use of the ITEX? PCplus 
library of image processing subroutines to develop individual 
image processing functions. The algorithms and the other 
image processing functions are implemented in the mouse- 
driven menu package using the GFX4 library of graphics 
subroutines. The PC system configured with these components 
is relatively inexpensive, portable, and easily modifiable to 
incorporate a number of image processing functions. 

This thesis is organized as follows. An object detection 
algorithm based on the computation of its center of mass is 


presented in Chapter II, a Kalman filter predictor algorithm 


1 Trademark of IBM 

2 Trademark of Imaging Technology Inc. 
3 Trademark of Imaging Technology Inc. 
4 Trademark of C Source Inc. 
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used for increased accuracy in the detection is described in 
Chapter III, and the Kalman filter edge detection technique 
is discussed in Chapter IV. Chapter V examines several 
methods of improving the tracking accuracy, Chapter VI 
investigates the potential of the Kalman filter edge 
detection technique as an approach to autonomous navigation, 
and conclusions and recommendations are presented in Chapter 


Vil. 


II. CENTER OF MASS ALGORITHM FOR OBJECT TRACKING 


A. GENERAL 

In this chapter we introduce an algorithm for tracking an 
object based on the computation of its center of mass. The 
center-of-mass technique is at the base of most of the 
developed tracking algorithms. Because of its simplicity, 
the algorithm can be implemented in real-time at a continuous 
output rate of nearly thirty frames per second. Even though 
the number of frames per second is slightly less when the 
algorithm is included in the processing, its effect is 
undetectable by the human eye. 

Another advantage of the algorithm is that all 
calculations are done in the spatial domain, rather than the 
frequency domain. This further reduces processing time and 
alleviates all memory storage requirements since the images 
are stored in the framegrabber board. 


The real-time implementation of the center of mass 


computation 1S based on two operations of the image 
processor: "snap" and "threshold". In particular, 

o Snap - acquires one frame from the video input, 
stores it in frame memory, and displays it on the 
monitor. 

o Threshold - separates the 256 possible gray levels 
into two regions, background and object. In ous 


application gray levels within a specified range, the 
threshold range, are designated as objects while all 
others are considered background. 


B. SEGMENTATION 

The operator must have some means of designating which 
object is to be tracked. Using a function developed by the 
author, the operator can use the mouse to designate the 
object. A cursor appears on the video monitor when the 
algorithm is implemented. The object is selected by using 
the mouse to position the cursor over it and pressing the 
left mouse button. 

The center of mass algorithm is based on the assumption 
that the image is binary, in the sense that only one object 
and background are present. Further, the intensity levels of 
the object and background must be separable or segmented by a 
thresholding operation. (The actual number of gray levels 
present in an image is 256.) The pixel values must be 
thresholded to reduce the 256 values to two values that can 
be implemented in the algorithm. A mean intensity value is 
computed by averaging pixel intensities in the vicinity of 
the cursor designation. A threshold range is established by 
adding and subtracting a tolerance level to the mean value. 
The tolerance level is dependent on the meaSurement noise, 
the desired sensitivity, and the extent of the object's 
homogeneity. The threshold output will have two distinct 
values, normally zero and one, although theSe values are 
application dependent. 

Figure 1 depicts the threshold range centered around a 


calculated mean value. Although the thresholding accounts 


for the 256 possible gray levels, it assumes that the object 
is nearly homogeneous with only slight variations in its 
intensity. This is a realistic assumption for many objects 
and iS a common assumption even in complex tracking 


algorithms [Ref. 2]. 
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Figure 1. Threshold Output 


C. ALGORITHM 

In order to perform the computations in real-time, a 
window is placed on the object to be tracked and the position 
of the window is updated according to the movement of the 
object. The window can be centered on the object as shown in 
Figure 2 since the object's initial location has been 
designated by the operator. This drastically reduces the 
number of calculations in the algorithm since only those 
pixel values within the window need to be examined. As the 
object moves, a new frame 1s snapped resulting in an image 
similar to Figure 3. 

The intensity value of each pixel, p(x,y), within the 
window of the new frame is sequentially examined in order to 
compute the center of mass of the object. The center of mass 
of the object is the point that represents the average x 
coordinate and the average y coordinate for the object. If 
the pixel belongs to the object, its x and y coordinate 
values are added to previous values; otherwise the pixel is 
ignored and the next pixel is examined. After all pixels 
within the window have been examined, the average x and y 
coordinates are calculated. This process is shown in the 
following algorithm. 

a=b=n=0 (initialize counters) 
for x,y = 1,N (examine only pixels within the window) 
if p(x,y) = 0 (pixel(x,y) belongs to the object) 


a=a+x (add x to coordinates) 


b= b+ y (add y coordinates) 
n= n+ 1 £=(number of pixels in the object) 
endif 
endfor 
cm, = a/n (average x coordinate) 
cmy = b/n (average y coordinate) 


The result of the algorithm (cm, , CM) represents the xy 
coordinates of the center of mass of the object. Using these 
coordinates, the window can easily be centered on the 
object's current location as shown in Figure 4. A new frame 


is snapped and the process is repeated. 





Figure 2. Centered Object 





Figure 3. Object After Motion 





Figure 4. After Center of Mass Calculation 


D. LIMITATIONS 
The implementation of the algorithms revealed three 
limitations that required further investigation in order for 
the tracking to be accurate. The three limitations are: lag, 
concealment, and intensity variation. Each of these are 
discussed below. 
i. Lag 
Although the object is within the window at the 
completion of each repetition of the algorithm, in general it 
is not centered. The continuous movement of the object 
during the computation of the center of mass causes the 
window to lag behind the object's motion. The predictor 
introduced in Chapter III solves this problem. 
2. Concealment 
As the object being tracked passes behind another 
object, it becomes partially or momentarily obscured. By 
design, the algorithm centers the window on the unobscured 
portion of the object. Eventually the centering is no longer 
accurate and the track is lost. The predictor discussed in 
Chapter III also solves this problem. 
3. Intensity Variation 
Changes in the object's intensity or gray levels (as 
when an object moves from shadows to bright sunlight or vice 
versa) results in the object being lost. The threshold range 
is no longer accurate for the object's new gray level. An 


object moving into a shaded area will change its intensity to 
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a gray level outside the threshold range. This results in 
the object being perceived as background. Chapters IV and V 


investigate possible solutions to this problem. 


a 


III. OBJECT TRACKING WITH PREDICTOR 


A. GENERAL 

In the previous chapter tracking is accomplished using 
only the data contained in the current frame, without any 
attempt to use the estimated dynamic motion of the object. 
This causes the tracking algorithm to lag slightly behind the 
object's movement and its performance to degrade when the 
object is temporarily obscured by other objects. These two 
problems can be eliminated if the future position of the 
object is estimated accurately. Various prediction 
algorithms can estimate the position of the object at time ts 
using past data from the interval [t, , ty] with ty > ty. 


J 


Here a Kalman filter predictor is used. 


B. ALGORITHM 

The future position of the object can be computed by 
adding the distance traveled to the current position. If the 
object moves uniformly, the distance traveled by the object 
during the time interval T can be approximated by the product 
of velocity and the time interval T. The discrete system 
that describes the object's motion can be characterized by 


the following discrete-time equations: 


Y(k+1) = Y¥(k) + T * V(k) (1) 
V(kK+1) = V(k) + F(k) (2) 
YEIOS) Met 1S) ae ACS) (3) 


ie 


where 

Mik) 1Smtherobgect Ss position at the time k (1.e., in the 
k-th frame). 

V(kK) is the object's velocity at time k. 

Z(kK) is the measured position of the object at time k. 

F(kK) is a random forcing function at time k. 

W(k) is a random measurement noise at time k. 

T is the time between measurements. 

In order to reduce the processing time, the algorithm has 
been simplified by assuming that the velocity is nearly 
constant. This is fairly common practice for even complex 
tracking algorithms (Ref. 2]. The random forcing function 
F(k) is assumed to have zero mean aid a variance of af. bie 
represents slight variations in the object's velocity. The 
measurement noise is assumed to have zero mean with a 
variance of 01°. It should also be noted that Y(kK) and V(k) 
are actually two-dimensional vectors since each has a 
horizontal and vertical component. The position and velocity 
will be left as single states for simplification since it 
does not affect the results. We can write Equations 1 - 3 in 


matrix form, as 


X(k +1) = ¢X(k)+TF(k) (4) 
Z(k) = CX(k) + W(k) (>) 


where X(k) is the two dimension state vector for the position 


and velocity and 


He 


C 


[1 0] 


From Equations 4 and 5, we can design a Kalman filter to 
predict the future position ([Ref. 3]. The predictor 


equations 


X (klk) = X(klk — 1) + G(k)]Z(k) - CX(kk -1)] (6) 


X(k + 1k) = @X(K|k) (7) 


are calculated on-line to predict the new position of the 
center of mass of the object. The terms in Equation 6 are 

X(k|k), the estimate of X(k) given measurements at times 

up to and including k; 

X(k|k - 1), the estimate of x(k) given measurements at 

times up to and including k - 1; and 

G(k), the Kalman filter gain matrix. 

Since the Kalman filter gain matrix is independent of the 
data and depends on the matrices @¢, I, and C only, it can be 
computed off-line and stored in a lookup table prior to any 
real-time computation. This gain can also be computed 


recursively according to 
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G(k) = P(kKlk-1)C'[CP(klk -1)C'+R] (8) 


P(k +k) = g[1 —G(k)C]P(kIk-1)9'+Q (9) 


where 

P(k + 1|/k) is the covariance matrix of the error estimate 

of the state, X(k + 1), given the measurements up to k. 

R is the covariance of the measurement noise W(k). 

Q is the covariance matrix of the random forcing function 

F(K). 

The matrix P(k|k - 1) is initialized using a priori knowledge 
of the initial intensity level X(0) and its covariance matrix 
P(0O). In the case of maximum uncertainty, P(0) is assumed to 
have a large value. The computation is terminated when G(k) 
reaches steady state. In all cases of our Simulations, 
Steady state is normally reached within twenty iterations. 

In the real-time application, the Kalman filter gain 
matrix, G(k), 1S reinitialized (k = 0) upon reaching the 
steady state gain in the algorithm. This is done to increase 
the sensitivity of the system to possible velocity changes in 
the event that the assumed constant velocity is not always 


observed. 


SeeeereoULTS 

The implementation of the predictor in the tracking 
algorithm requires only four additional lines of code with 
the use of lookup tables. The four lines of code represent 
the predicted horizontal and vertical components of the 
position and velocity. 


£ 


Although the introduction of the predictor algorithm 
increases the processing time, the on-line computations are 
so few that the tracking algorithm still operates in real- 
time on the PC. A video signal with various background 
clutter (e.g., trees) was used to test the reliability of the 
predictor. The object was free to pass on either side of the 
clutter. This required the tracker to detect the object 
after momentary concealment. The predictor algorithm 
continued to move the window according to the object's last 
calculated velocity while the object was obscured. As the 
object emerged from behind the obscuration, it appeared 
within the window and tracking resumed. 

As a result of this algorithm, the window no longer lags 
behind the object's motion. The tracker is able to detect 
the object as it emerges from behind the background clutter 
if the size of the obscuring barrier is limited to 
approximately one half the size of the window. 

Figure 5 shows a plot of the object location in xy 
coordinates using both the center of mass algorithm and the 
predictor algorithm. Since the object is moving in the 
negative direction for both coordinate values, the center of 
mass plot lies above or lags behind the smooth predictor 


plot. 
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Fal 
gure 5. Object Location (Center of Mass vs. Predictor) 
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IV. KALMAN FILTER EDGE DETECTION 


A. DESIGN APPROACH 

The previous chapter showed how an object can be tracked 
by combining segmentation with the computation of the center 
of mass. Although the results are satisfactory under 
constant uniform lighting conditions, the presence of shade 
and variations in the object's luminosity cause the algorithm 
to lose track of the object. An alternative approach based 
on edge detection does not degrade in the presence of changes 
in luminosity. In this chapter, we show a novel 
implementation of edge detection based on the Kalman filter 


which can be implemented in real-time. 


B. EDGE DETECTION 

An edge is defined as the boundary between two regions 
with distinct gray level intensities. If the edges of the 
object being tracked are known, they can be used in the 
center of mass algorithm just as effectively as the entire 
object but with less computation. Most edge detectors 
display the edges as bright pixels while non-edge pixels, 
which are treated as background, appear dark. The edge 
detector essentially thresholds the image into two distinct 
gray levels. The center of mass algorithm can then simply be 


applied to the edge image. 
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C. THEORY 
Most edge detection techniques involve the computation of 
a local derivative operator. For example, the Laplacian 


operator is a second-order derivative operator defined as 


a’ f a’ f 
Li Aes, cn oe LN (10) 
where f(x,y) represents an image. The digital Laplacian 


operator at a pixel, p(x,y), is defined as 
UA oral l= ee ea XX, ae (11) 


where x, through xg represent the gray levels of the pixels 
in a 3 by 3 neighborhood about p(x,y) shown in Figure 6. The 
Laplacian edge detection operation iS implemented by 
convolving the 3 x 3 mask of Figure 7 with the image f(x,y). 
[Ref. 1] This computation is quite time consuming and not 


well suited for real-time processing. 





Figure 6. 3 x 3 Image Region 


a9 





Figure 7. Laplacian Mask 
A much simpler approach using a Kalman filter is 
examined. The typical plot of intensity levels on a 
horizontal line is shown in Figure 8. Basically, the signal 
is piecewise constant with a small variation or disturbance 
superimposed; the disturbance accounts for both observation 


noise as well as details of the object and background. Each 
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Figure 8. Horizontal Line of Pixels 
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horizontal line can be represented as a noisy measurement 
Signal, 2Z2(k), where the signal is composed of two distinct 
regions, background and object. Within each region the true 
Signal, X(k), is nearly constant (of uniform intensity). 
However, since complete uniformity in an image is unlikely, 
X(k) will typically have slight variations around the average 
intensity level. The signal and its measurement for each 
region can be characterized by the following state and 
measurement equations: 

X(k +1) = X(k)+ F(k) (12) 

Z(k) = X(k)+W(k) (13) 
where 

X(k) is the true intensity signal. 

Z(k) 1s the noisy measurement. 

F(k) 1s a random forcing function with zero mean and 
variance o¢* to account for the small variations in 
intensity. 

W(k) is the measurement noise with zero mean and variance 

ore 
A Kalman filter can be used to estimate the true signal 


in each region. Applying the Kalman filter 


X (kik) = X(klk 1) + G(k)| Z(k) - CX (kk -1)] (14) 


X(k + 1k) = oX(Kk) (15) 


Zr 


to the signal shown in Figure 8 would result in an estimate 
similar to Figure 9, a smoothed version of the input signal. 
The goal of the filtering is to produce an output similar to 
Figure 10 where the edges are detected and the signal is 
filtered separately within each region. Once an edge is 
detected, the filter gains can be reinitialized to begin 
filtering of the next region. It is necessary, however, to 
detect the edges while filtering so that the Kalman filter 


can be reinitialized. 


D. DETECTING THE EDGE 

A simple algorithm can be incorporated into the filtering 
to detect the object's edges. The algorithm takes advantage 
of the Kalman filter's statistical properties discussed 


below. 


Intensity 


X-Coordinate 





Figure 9. Filtered Signal 
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Intensity 


X-Coordinate 


Figure 10. Desired Filtered Signal 


Given the state space model 
X(k +1) = @X(k) + TF(k) (16) 
Z(k) = CX(k) + W(k) (17) 
where F(k) and W(k) are Gaussian, it is possible to show the 


following results [{Ref. 4]: 


P(X(k)|Z(k — es (0)) = N(X(k), P(K{k ~ 1)) (18) 
P(Z(k)|Z(k -1),...,Z(0)) = N(C'X(k),C'P(k|k - 1)C + 0% | eS) 
Therefore, given a set of observations Z(0)..... Z(k), we can 


determine the probability that the observations belong to the 


model by using the conditional density 


Zo 


1 1 IZ(k)-C'X(kf 


P(Z(k)|Z(k -1),...,Z(0)) = V2x(C'P(kk-1)C +02) P 2 (C'P(k|k—1)C + 02) 


(20) 


with X(k) and P(k|k - 1) derived from the Kalman filter. 
Subtracting the mean and dividing by the standard deviation 
changes Z(k) to a Gaussian random variable with zero mean and 


unity standard deviation. We define this value as E(k). 


a 


1 ie i 21 
JC'P(Kk—1)C + & a. 


P(E(k)) = N(0,1) a 


Using statistical theory, confidence intervals for E(k) can 
now be established. The absolute value of E(k) can be 
compared to a tolerance level, €, which represents the 
desired confidence interval. For example, an € value of 2.0 
represents a ninety-five percent confidence interval. 
Therefore, if the absolute value of E(k) is greater than 2.0, 
then the probability that Z(k) is an edge is greater than 
0.95. The algorithm can be stated in the following format: 

Oo Compute E(k). 

o If |E(k)| > €, then an edge is detected, reinitialize 

the Kalman filter. 


Else; no edge detected, update the Kalman filter. 


o Continue filtering. 
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E. ANALYSIS OF EDGE DETECTION TRACKING 

The Kalman filter edge detector was analyzed from three 
perspectives: accuracy, speed, and reliability. Prior to 
comparing the Kalman filter to other edge detectors, it has 
been necessary to determine the Kalman filter's ability to 
accurately detect edges. The algorithm was found to be 
extremely accurate when the variances of the random forcing 
function, F(k), and the measurement noise, W(k), are properly 
chosen; basically by a priori knowledge and trial and error. 
The algorithm was not found to be overly sensitive to 
variations of these parameters and it performed 
satisfactorily for several values of the parameters. One 
limitation of the Kalman filter as an edge detector is its 
ability to detect a perfectly horizontal line. Since the 
image is filtered horizontally, a perfectly horizontal edge 
will only be detected at each end of the line. This has not 
proven to be a significant limitation since few objects in 
the actual tracking had perfectly horizontal edges. Figures 
11 and 12 show a typical object before and after edge 
detection using the Kalman filter. 

The speed of the Kalman filter edge detector is far 
better than anticipated. The tracking algorithm with the 
Kalman filter edge detector can still be performed in 
real-time in spite of the increase in processing time due to 
the Kalman filter edge detector and the center-of-mass 


algorithm. 
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Figure 12. Object After Edge Detection 
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The source code is written such that each pixel value 
within the window is examined only once. This represents a 
marked improvement over other edge detectors, such as the 
Laplacian. The Laplacian edge detector examines each pixel 
value nine times and the center of mass algorithm examines 
each pixel one more time. For this reason, the tracking 
algorithm using the Laplacian edge detector could not be 
implemented in real-time on our system. 

The goal of the edge detector is to overcome the problem 
of intensity variation. Its ability to accomplish this task 
is used as a test of its reliability. Initially, the edge 
detector is implemented in conjunction with a homogeneous 
background. Under this condition, intensity variations do 
not hinder the algorithm's ability to track the object. 
However, the edge detector failed to be reliable when 
implemented in a complex background. The Kalman filter 
detected all edges within the window, but as the tracked 
object approached another object, the tracking algorithm was 
unable to distinguish between the two objects. The-center-of 
mass algorithm then failed to center on the tracked object 
and eventually track was lost. Figures 13 and 14 show the 
edge detection using the Kalman filter of an object in a 
complex background. Although the edge detector overcame the 
problem of intensity variation, its inability to track 
objects in a complex background made it very unsuitable for 


implementation. 
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Figure 13. Image with Complex Background 
Before Edge Detection 
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Figure 14. Image with Complex Background 
After Edge Detection 
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V. ADJUSTING THE THRESHOLD RANGE 


A. GENERAL 

Although the edge detector proved to be effective in the 
presence of intensity variations, its inability to be used 
with a complex background made it undesirable to implement in 
a realistic situation. An alternative to edge detection is 
to adapt the threshold range discussed in Chapter II to the 
changing intensity level. This chapter examines two methods 


for adjusting the threshold range. 


B. MOVING AVERAGE 

The simplest method for adjusting the threshold range is 
by a moving-average calculation. During the thresholding 
operation, the pixel values within the threshold range are 
averaged to calculate a new mean value for the object's 
intensity. The threshold range is then centered around the 
new mean value; this allows the tracker to adjust to slow 
changes in the intensity level. When implemented, this 
method adapts well to slow changes in the intensity level of 
the scene. However, rapid changes in the intensity level due 
to sudden changes in shading escape the floating thresholding 
range. Since no pixel value falls within the threshold range 
when this occurs, the moving average in this case is zero and 


track of the object is essentially lost. 


Sieh 


Cc. LOST OBJECT CALCULATION 

When rapid changes occur, the object's intensity no 
longer falls within the threshold range. The object appears 
as background and is lost by the center of mass algorithm. 
The predictor discussed in Chapter III would indicate that 
although the object is lost by the algorithm, it should still 
appear within the window. A moving average of zero indicates 
that the intensity level has changed too rapidly for the 
moving average algorithm and that the object has been lost. 
Upon receiving this indication, a new threshold range is 
calculated to reflect the intensity change. 

Computing the mean intensity value within the window 
appears to be a viable method of establishing a new threshold 
range. However, the background intensity values can skew the 
mean value. If the skew is greater than the tolerance level 
in the threshold range, the object's intensity level will 
still be outside of the threshold range and the object will 
still be undetected. In addition, this method requires that 
the object be at least one-half the size of the window and 
that is not always the case. 

A variation to this method is to rely on the accuracy of 
the predictor. Since the predictor proved to be sufficiently 
accurate in estimating the object location, one can assume 
that the object is within the range of the window. 
Therefore, if the mean value is calculated for a much smaller 


portion at the center of the window (approximately one 


SZ 


fiftieth), the mean value should reflect only the object's 
new intensity. 

This method of adjusting the threshold range is very 
effective at adapting to rapid intensity variations. During 
implementation the object being tracked is frequently lost by 
the center-of-mass algorithm, but the lost-object calculation 
recomputes the object's intensity and the algorithm continues 
eomierack . 

A flow chart of the tracking algorithm including the 
threshold range adjustments is shown in Figure 15. A single 
image frame is acquired using the snap operation. The image 
is segmented into a binary image using the threshold 
operation and each pixel value is subsequently examined to 
determine to which region (background or object) it belongs. 
The intensity levels and the x and y coordinates of pixels in 
the object range are summed for use in the center-of-mass 
calculation and the moving-average threshold range 
Calculation. The pixels are scanned sequentially across each 
row and down each column until all pixels within the window 
have been examined. The center of mass is computed using x 
and y coordinate sums and the threshold range is adjusted 
using the moving average technique. When no pixel values 
fall within the threshold range, a new threshold range is 
computed using the lost-object calculation. The predictor 
algorithm and the new center of mass are used to center the 


Window and the process is repeated. 
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D. UNRESOLVED PROBLEMS 

Although the lost-object calculation compensates for 
rapid intensity variations, it is not sensitive to small 
differences between the background and the object. When the 
background intensity is within a few gray level values of the 
object intensity, the background intensity level falls within 
the threshold range and the background is perceived as the 
object. The window centers on a combination of the object 
and the background, and in most instances, locks onto the 
background as the object continues to move. This problem 
occurs primarily when one of two conditions exist. First 
under very sunny conditions, background objects that are 
reflective can be mistaken as the object if the object being 
tracked is itself bright. The reflection from the background 
objects are bright spots very similar to the tracked object. 
Secondly, on a cloudy day, a dark object being tracked can be 
confused with the background in an excessively shaded area. 
Under both conditions, the object being tracked remains 
visible and its motion can be followed by the human operator 
on the video monitor; but the difference between the 
intensity levels is so small that the algorithm cannot 


distinguish between the two. 
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Figure 15. Flowchart of Tracking Algorithm 
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VI. AUTONOMOUS NAVIGATION 


A. GENERAL 

Although the Kalman filter edge detector cannot be 
realistically implemented for tracking moving objects in a 
complex background, itS accuracy and speed as an edge 
detector warrants further investigation for its use in 
autonomous navigation. Autonomous navigation represents a 
situation related, but complementary to, object motion. In 
autonomous navigation the motion results from the movement of 


the camera position. 


Bee Loony 

Assume that a camera 1S mounted on a moving platform such 
as a vehicle and is initially directed toward the edge of the 
Oa. A window similar to that discussed in Chapter II is 
Superimposed on the input image as shown in Figure 16. The 
window is free to move horizontally across the image as if 
the camera iS panning, but the vertical movement of the 
window is fixed to reflect some specified focal point for a 
given distance in front of the vehicle. As the vehicle moves 
forward, the image changes to reflect the vehicle's movement 
and the curvature of the road. When approaching a curve in 
the road, the image has an appearance Similar to Figure 17. 


The window can track the edge of the road by implementing the 
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Kalman filter edge detector in conjunction with the center- 
of-mass algorithm discussed in Chapter IV. Centering the box 
on the edge of the road is equivalent to panning the camera 
to center the road edge. However, if the camera is mounted 
rigidly to the vehicle, the vehicle will have to turn in 
order to maintain the road edge in the center of the window. 
The output of the algorithm can thus be used as a control 
input to steer the vehicle. Given a sufficiently accurate 
edge tracking algorithm, the vehicle should be able to 


navigate along the road without any human intervention. 


C. APPLICATION 

The algorithm used to test this autonomous navigation 
concept is identical to the tracking algorithm described in 
Chapter IV with one exception. In the tracking application 
the algorithm is free to move in all directions, while in the 
autonomous navigation application, vertical movement is 
restricted to reflect the vehicle's ability to manuever only 
in the horizontal direction. The input source used to test 
the algorithm's performance is a video tape taken from a car 
traveling at normal speeds along various roads. 

The algorithm appears to be effective at following the 
edge of the road and is not adversely affected by a complex 
background since the camera is kept pointed toward the road 
edge. At a typical road intersection no edge will be 
detected, since there are no berm or line markings. The 
algorithm provides no centering input in this case and the 
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window remains at the previous location. Therefore, as long 
as the intersection does not occur on a sharp curve, the 
algorithm would continue to supply control inputs once the 
vehicle has passed the intersection and a berm or line 
marking iS again present. The effectiveness of the algorithm 
can be increased by using additional cameras focused on the 
opposite edge of the road and/or on the center line. Figure 
18 is an example of such an implementation. The additional 
cameras increase the overall accuracy of the autonomous 
navigation algorithm since there are three edge detectors, 
one for each camera. The three edge detectors will 
complement each other and reduce the possibility of an 
erroneous control input that may occur when an intersection 
is on a curve. The three edge detectors may have different 
varlance parameters and tolerence levels to reflect the 
possibility of differences in the road edges and road 
surface. The speed and accuracy of the algorithm makes it a 
very viable method for autonomous navigation. Figures 19 
shows a typical road edge after edge detection for a windowed 


area. 


oy) 





Figure 18. Three Camera Implementation 
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Figure 19. Road Edge After Edge Detection 
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VII. CONCLUSIONS 


The problem of tracking an object in real-time is 
primarily one of speed and accuracy. The speed at which 
processing can be completed determines whether real-time 
image processing can be maintained. 

The simplicity of the center-of-mass algorithm allows for 
a minimum amount of calculations, thus minimal processing 
time. Its simplicity also permits additional algorithms to 
be implemented simultaneously in order to enhance its 
performance. 

In this research we have shown that the tracking 
algorithm with the predictor and moving-average algorithms, 
together with the lost-object calculation, performs 
satisfactorily. Tracking is lost only when background and 
object intensity difference are less than the tolerance 
within the threshold range. This occurs primarily in bright, 
sunny conditions for a light-colored object and under dark, 
cloudy conditions for a dark object. The operator's 
inability to designate fast moving objects limits the speed 
of the objects to reasonable video velocities. Once the 
object is designated, the speed is virtually unlimited. 

The introduction of the Kalman filter as an edge detector 
provides some promising results. The Kalman filter is far 
Superior to other edge detectors in terms of processing 
speed. Although it is not as accurate as most derivative 
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operator edge detectors, its ability to detect edges is 
precise enough for many applications. Initial results of its 
potential as a means of autonomous navigation is promising. 
Its capability in this area of image processing and control 
is one that merits further investigation. 

The microcomputer package developed is’ relatively 
inexpensive, portable, and easily modified to incorporate any 
image processing function. The menu system provides an easy 
means to implement developed algorithms as well as common 
image processing routines that are contained within the ITEX 
library. The menu system can be used for detailed analysis 
of a single image frame or to investigate the application of 


image processing algorithms in real-time. 
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APPENDIX A 


MICROCOMPUTER PACKAGE 


A. GENERAL 

The microcomputer package we developed is a collection of 
subroutines that can be selected from a mouse-driven menu. 
The menu system used to implement the routines is a software 
package developed by C Source, Inc. This software package 
contains graphics, font, and menu libraries which may be 
utilized to design various displays. This chapter describes 


the microcomputer package and the routines it incorporates. 


B. IMAGE PROCESSING SYSTEM 

The components of the image processing system are shown 
in ‘Fagure 20s (Ret -> ie The image originates at a video 
source such aS a camera or a video tape player. The analog 
video signal is sent to the framegrabber (enclosed within the 
dashed line in Figure 20) where it is initially digitized by 
an analog-to-digital (A/D) converter. The digitized signal 
is passed through an input lookup table (LUT) which maps 
intensity levels to values programmed by the operator. The 
transformed signal is then stored in the frame memory of the 
framegrabber. 

The framegrabber has two available memories which can be 
selected by the computer. The contents of the frame memory 
are sent to the video monitor for display through an output 
lookup table (which operates in the same manner as the input 
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lookup table) and a digital-to-analog (D/A) converter. The 
contents of the lookup tables and the frame memories are 
accessible from the computer for processing applications. 


[Ref. 6] 


Video 
Wonca 


Computer 


Monitor 





Figure 20. Image Processing System 
(from Reference 2) 
C. MENU DISPLAY AND SELECTION 
The menu begins by displaying the video modes that the 
system will support. The menu package at this PC system has 
been hardwired for a VGA video mode to conserve memory. The 
video mode is easily changed by using the correct video mode 


number in the source code. Striking any key will cause the 
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menu display to be activated. Figure 21 is an example of the 


menu display. 





Figure 21. Display Example 


The titles across the top of the screen are known as the 
root menu. The root menu is an easily identifiable title for 
processing functions that perform similar operations. Below 
each root menu is a pull-down menu. The pull-down menu is a 
list of the image processing functions that can be 
implemented under that root menu. 

The selection of a root or pull-down menu may be 
accomplished by two methods. The cursor may be positioned on 
the desired menu using the mouse and selection made by 
pressing the mouse _ button. Selection may also _ be 
accomplished by pressing the hot key (highlighted) of the 


desired function on the keyboard. 
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D. MENU SELECTIONS 
1. Read/Save 
a. Read 
Reads an image from a disk file into the 
Framegrabber memory. Prompts for input of the filename, 


image size, noise variance of image, and tolerance for 





filtering. 
b. Save 
Stores 512 x 512 image displayed on the video 
monitor into the disk file. Prompts for input of the 
filename. 


2. Display 
a. Grab 
Continuously acquires image frames from input 
source and displays them on the video monitor. 
b. Snap 
Acquires a single 512 x 512 image frame from the 
input source, stores it in the framegrabber memory, and 
displays it on the video monitor. Initializes measurement 
noise covariance, R, to twenty; random forcing function 
covariance, Q, to one; initial state covariance, P, to four; 
and the error tolerance level, t, to 1.5. 
c. Reinitialize Post-filter 
Reinitialize display to original image after 


using Kalman filter edge detection on a single frame. 
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dad. Reinitialize Post-threshold 
Reinitializes display to original image after 
using thresholding on a single frame. 
Sew T 
a. Set LUT 
Selects which 256-byte output bank is used for 
the output video transforn. Prompts for input of bank 
number. 
b. Store LUT in Array 
Stores LUT values in an array and converts 
framegrabber memory to reflect LUT transforn. Prompts for 
input of the bank number and queries on area to be converted. 
4. Analysis 
a. Histogram 
Computes and displays the histogram of the image. 
Queries on the area for which the histogram is to be 
computed. Strike any key to continue processing. 
b. Equalize 
Displays histogram equalized image on the video 
monitor. Queries on the area for which equalization is based 
and the desired bank for the equalization LUT. 
5. Processing 
a. Kalman Filter 
Filters a designated area of a single frame as 


discussed in Chapter IV. 
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b. Track 
Tracks a designated object using the center of 
mass algorithm. The predictor algorithm and intensity 
variation improvements are incorporated. 
c. Kalman Edge Detector 
Tracks a designated object using the Kalman 
filter edge detector discussed in Chapter IV. 
ad. Autonomous Navigation 
Centers a window on a road edge continuously as 
discussed in Chapter VI. 
e. Threshold 
Thresholds a single frame of an image. Prompts 
for input of the threshold value and queries on the area for 
which thresholding will be done. 
6. Parameters 
a. Target Area 
Designates target area for further processing or 
analysis. A cursor is displayed on the video monitor for a 
Single image frame. Cursor can be positioned over desired 
area using the mouse. Depression of the left mouse button 
will center a rectangle on the target area. The rectangle 
size can be increased or decreased using the query boxes on 
the computer screen. 
b. Covariance - P 
Allows for changes to the covariance, P, of the 


initial states. Prompts for input of the new value. 
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c. Covariance - 


Allows for changes in the covariance, Q, of the 
random forcing function, F(k). Prompts for input of the new 
value. 

dad. Error Tolerance 

Allows for changes in the error tolerance level. 
Prompts for input of the new value. Values are normally 
between one and two. 

e. Covariance - R 
Allows for changes to the covariance of the 


measurement noise, W(k). Prompts for input of the new value. 
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APPENDIX B 


JL ERRARRERREREERRERERARRREEERRERERAERAKS 


& ® 
* MENU . 
a x 


RRR ARERRRRRRRERKRARRERRARKERERKAARE / 


#include "mer _menu.h" /* neader w/user changes */ 


/* A jump table of the functions called by pull-down menu items. 
* The position in the array is the same as the associated item's 
* position in the PDM_DEM array.*/ 
LOCAL void (*pull_down_vec([})() = 
({ read_image, save_image, grab_it, snap_it, 
reinit, thres_reinit, set_lut,store_lut, 
histo_gram, histo_equalize,snap_kalman, 
track_predict,kalman_edge,auto_nav, thres_hold, 
snap_rect,init_p, init_q, tolerance, variance}; 


/* A simple translation table to go from the list of 
* accepted video modes to the actual bios mode numbers. *t/ 
inex lat video[}) = { 0, 4, 6, OxD, OxE, 0x10, OxF, Ox1l2, Oxll, 0 }; 


/* Message displayed when the program is started. */ 

TEXT *usage_ msg[J= (" \n THIS PROGRAM HAS BEEN HARDWIRED", 
"FOR A VIDEO MODE OF 640x480x16,", 
"AVAILABLE MODES ARE LISTED BELOW:", 

"\n Supported Video Modes", 

~ 320x200x4 2. 640x200x2 ", 

"3. 320x200x16 4. 640x200x16", 

"5. 640x350x16 6. 640x350x2>", 

"7. 640x480x16 8. 640x480x2 ", 

si 9. Hercules", 

le 

"WARNING: BE SURE YOUR HARDWARE", 

" CAN SHANDLE “THE SELECTED MODE.” , 

bee 


LOCAL INT clear_color, dfit_fh, pd_ascii_code, curr_video_ mode; 


main(argc, argv) 
[NT argc; 
TEXT *argv[); 
( 
FAST INT 1; 
Been) *ev, *get event(); 


/* print out initial messaget/ 
for(i=0;1<(sizeof (usage msg)/sizeof (TEXT *));puts(usage msg[(i++))): 


getch(); /* halts display until a key is hit */ 

[etek ekhehhe es initialization of the frame boara kkk kak R RRR RR RAK / 

sethdw(0x100,0xDOOOOL, DUAL); /* defines hardware address for 
registers and frame memory +*/ 

Setaqim(S5l12,512,8); /* sets board dimensions */ 

maon() ; /* turn on board */ 

Piaztialize(); /* initialize all registers */ 

setvmask(0x00); /* set the video mask for an aquire */ 

sclear(255) ; /* clear screen white */ 


S BERR RERRRERRERRAKR ERE ARERREAEREAERAARERERRERRERERREREKEREREEE / 


on 


init_loop: /* marker for reinitialization after plotting histogram */ 
1= 7; /* Hard wire for 640 X 480 X 16 */ 
curr_video mode = xlat_video[i]; /* get true bios mode number */ 


/* Call the local function to set the graphics mode. 
* This function also determines the appropriate default 
* font, depending on the video resolution. 
KEKE KREMER EEE KKKKKK KK KKK KKK / 
SCREEN(0x8000 + curr _video_ mode) ; 
dflt_fh = open _mem_font(&iss_stl4); 
Clear_color = 15; 


_9fx_color_box(0, 0, _gfx.max_x, _gfx.max_y, clear_color); 
J BREE / 


/* run easy startup routine (in AUTO_MNU.C) for initialization */ 
init_auto_gfx_menu(1, Ox800, 2, dflt_fh, 640, 480); 


/* take care of variable resolutions and color problems */ 
reset_auto_cs_layout (YES) ; 


set_root_menu(&root_menu) ; /* register & display the root menu */ 
mouse_show_crsr(); /* show the mouse cursor */ 


/**kkk Continue getting event until exit *****/ 
[ERKRKKKKKKKKKKKK KKK KKK KKK KKK KK KKK kkk kkk kkk kK KK KK KK kk kK / 
while (1) { 

ev = get_event(1l); 
pd_ascii_code = ev->ascii_code; 


/* determine pull-down menu */ 
if (ev->scan_code == PULL_DOWN_SCAN_ CODE) 
(*pull down_vec({ev->ascii_code}) (); 


/* if quit is select then exit in quit function */ 
else if (ev~>scan_code == ROOT_MENU_SCAN CODE) then quit(); 


/* if histogram is selected reinitialize after display */ 
if (ev->ascil_code== 8) 
{goto init loop; )} 
clear_menus(); /* clears pull-down menus */ 
} 
} 
[RRR KKK KKK KK KEKE KKK EEE EKEKKKKKKKKKKK KKK KKK KKK KKK KKK KKK / 


/*ek** BYE FUNCTION **#4%/ 


OBIE SOUS GIGI GII GIGI EIS SEIS IS OIIOEI TOIT O OTITIS II III IIE 
/* This is used to exit the menu system and reset things to normal. */ 


bye() 
{ 
haltuq (ir, /* decouples from keyboard interrupt */ 
faer ra, /* turn off board */ 
SCREEN (0); /* reset screen mode */ 
exit(l); 


[REKEEEKKKKKKKKKKKKKKKKKKAKKKKKKKK KAKA KKK KKK KAKA KKK KKK KKK KKK KKK IKK / 


22 


[/xaekeek QUIT MENU #&t etek / 
J BRR III KIS TIKI KK KK III KK KK II KKK KI IIIT IKK TKI KIS I IIIA KARA ERE KAKA KK KKK / 


/* This function displays dialog box to confirm desire to exit menu. */ 
TEXT *quit_text[] = {"Are you sure you", "want to leave the program?"); 
void quit() 

( 


GFX_BOX *gbox; 
EVENT *ev; 


/* display dialog box */ 
gbox = build _auto_box(DBOXO, (TEXT *) 0, 2, dbox_init(quit_text) }; 
ev = set_box_wrt_menu(JUSTIFY_END, 0, 0, gbox); 


if (ev->ascili_code == OK_BUTTON) ({bye();} /* exit if button OK */ 
Clear box(); /* else clear dialog box */ 


} 


J RRR ERE KK RE KKK KKK KKK KKK EEK KKK KEKE KEKE KKK EERE KEKE KKK / 


/**xkkk*k READ IMAGE **e*%%/ 
J RRR RRR II KKK RIK RII IKK RR II KK IIIT KIKI KK TK KI RII IKK RR IKK KR KR RR RK / 


/* This function reads in a single frame and initializes parameters */ 
void read_image() 


int err,view_hand; 

char comment[200]; 

INT PAR *par_ ptr; 

INT SIZE *size_ptr; 

GFX_BOX *gbox; 

EVENT *ev; 

static char name(20],resp_size[3]; 
static char resp var[6),resp_tol[3]; 


/* Form box displayed for input */ 
static FORM ENTRY form[([]={ ("Filename" ,name,20}, 
("Image size",resp size,3}, 
{"Variance",resp var,6}), 
{"Tolerance”,resp tol,3)}; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
size ptr=(INT_ SIZE *)&image_size; /* and image and window sizes*/ 


/*x*ek* Display forms box *****/ 
gbox=build_auto_box(FBOXO, (TEXT *) 0,2,fbox_init(form)}) ; 
ev=set_box_wrt_menu(JUSTIFY_START,0,0,gbox) ; 
if (ev->ascili_ code == CANCEL BUTTON) 

{ clear _box(); 


return; 
) 
J RRRKKKKKEKKKEKEKKKEREKEKKEKEEEKEK / 
/*** Initialize parameters ***/ 
size ptr->size=atoi(resp_ size) ; /* image size * / 
par ptr->var=atof(resp var); Ves R matrix */ 
par ptr->tol=atof(resp tol); /* error tolerance */ 
size ptr->initx=(512-(size_ptr->size))/2; [RRR RK KR RK KK RR RR / 
size ptr->inity=size ptr->initx; /* */ 
size ptr->maxx=size_ptr->size; PRemrovareaisplay */ 
size ptr->maxy=size_ptr->maxx; /* coordinates. if 
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size ptr->a=size_ptr->initx; /& | 


Size _ptr->b=size_ptr->inity; /* * / 
size_ptr->dx=(size_ ptr~->maxx)-(size_ptr->initx) ;/* ba 
size_ptr->dy=size_ptr->dx; [REE KK AK / 
par_ptr->q=1; /* Q matrix x/ 
par ptr->pinit=4; /* P matrix x / 


[RRR KKK KEKEEKEEEEEEREKEE / 


/***x* read in image using the readim command ****/ 
seléct_mem(MEM_A)j; /* select frame memory A x / 
if ((err==readim(size ptr->initx,size_ptr->inity, 

Size ptr->dx,size_ptr->dx,name,comment) ) <0) 
{ 
switch (err) { 
case FILE ERROR: 
printf("error opening file\n"); 
break; 
case FORMAT ERROR: 
printf("unknown file format\n"); 


break; 
default: 
printf("unknown error\n") ; 
break; } 
exit(1); 
} 
display _mem(MEM_ A); /* display memory A x / 
select_mem(MEM_B); /* select frame memory B */ 
display _mem(MEM _B) ; /* display memory B * / 


readim(size_ptr->initx,size_ ptr->inity, 
Size ptr->dx,size_ptr->dx,name,comment) ; 
clear_box(); /* Clear forms box */ 


} 


JERK EEREKEKEKEKKEKEEKE / 


/xeeeek SAVE IMAGE *#%e%%/ 


J ERR EKKEKEKEK EERE KEKE EERE EKEEEEKEKEEKEKEEEEKEEEKEKEEEEKEKEKEEK / 
/xxkkkkkk This function saves a single frame to a data file. ****kkx*/ 


void save_image() 
{ 
int err; 
INT PAR *par_ptr; 
INT SIZE *size ptr; 
GFX_BOX *gbox; 
EVENT *ev; 
static char name[20},comment[20]; 
/* Forms box displayed for input */ 
static FORM ENTRY form[]J={ ("Filename" ,name,20), 
{"Comment",comment,20}}; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
Size_ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


/* Display forms box */ 
gbox=build_ auto_box(FBOX0, (TEXT *) 0,2,fbox_init(form) ) ; 
ev=set_box_wrt_menu(JUSTIFY_START,0,0,gbox) ; 
if (ev->ascii_code == CANCEL BUTTON) 
{ clear _box(); 
return; 


} 


[ERR EKKEKKEEKKKKEKKEKEEK / 


o4 


/* Save image using saveim function */ 
if ((err==saveim(size ptr->a,size_ ptr->b, 
512,512,EIGHT_BIT,name, comment) ) <0) 


switch(err) 


{ 

case FILE ERROR: 
printf("error opening file\n"); 
break; 

case FORMAT_ERROR: 
printf("unknown format selected\n") ; 
break; 

default: 
printf("unknown errortd\n") ; 
break; 


} 
ExXre(l): 
} 


J RERRKKKEKEEKKEKKEKEKKKKKKKE / 
Clear_box(); /* clear forms box */ 


J RHEE EERE KEE KKK EERE EKER KKK EKER KEE KEKE EKER KKK KKREKKEREKRKK / 


[/xkekkke GRAB ttkkkke / 
J BRR RI I KT TT RI I RI TTT ITT TT TKK TTT TTI KT TT TTI TTS RITA RRR KR RK / 


/*** This function continuously acquires image frames...real-time ***/ 


void grab_it() 
{ 
grab(-1); 


[RRR KEKE KKK KEKE KEKE KEKE KR ERE EEE KEKE KEE EKEEKEKKKKEKEKEKKE KK KEK / 


[kekKKKK SNAP kKekeKKK/ 
J RRRR RK REE IIR REI REE IIR ERE RE REI KKREKRIK KEE IKHEEREKREKEKEKEAK KKK KKK KK / 


/* This function acquires a single frame and initializes parameters */ 
vold snap_it() 
INT_PAR *par_ ptr; 
INT SIZE *size ptr; 
par _ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
size ptr=(INT_SI2ZE *)&image_size;/* and image and window sizes*/ 


display _mem(MEM_B); /* display memory B */ 
snap (WAIT) ; 


/* Initialize parameters */ 


size_ptr->size=512; /* image size x / 
par_ptr->var=20; /* R matrix */ 
Pal peL--tol—1. >, /* error tolerance */ 
Size_ptr->initx=(512-size_ptr->size)/2; CREE EREEERERE EEK S * * / 
Size ptr->inity=size ptr->initx; /* x7 
Size ptr->maxx=size_ptr->size-1; /* Initial display */ 
size _ptr->maxy=size_ptr->maxx; /* */ 
Size_ptr->a=size_ptr->initx; /* coordinates iy! 
size ptr->b=size ptr->inity; /* af 
size_ptr->dx=size_ptr->maxx-size_ptr->initx;/* 7, 
size ptr->dy=size ptr->dx; [RR RR RR RK / 
par_ptr->q=1; /* Q matrix * / 


D0 


par ptr->pinit=4; /* P matrix * / 


J BRK KEKE KKK EKER RIKKI KKK KK KKK KKK KKK KK EKKKKKK KKK / 


[kxkkkKK REINITIALIZE POST-FILTERING **2%%%%/ 
J BRR IKI REI KIKI RIKKI III III KEI III KIKI IIA III KIRK IIIS DATA AKIRA KHAKI / 


/* This function will reinitialize the image after filtering to the */ 
/* original image. ay, 


void reinit() 
( 


char comment[200]; 

INT_PAR *par_ptr; 

INT_SIZE *size ptr; 

par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
size_ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


select_mem(MEM_B) ; /* select memory B id 


/* Read original image from temporary file */ 
readim(size_ ptr->a,size ptr->b,size ptr->maxx, 
size ptr->maxy,"temp1",comment) ; 


display _mem(MEM_B) ; /* display original image x / 
} 


J BRR RRR KKK KKK KIKI IKKE KKK II KKK KKK IKKE KKK IKKE KKK KKK KEK KEEKKKK EK / 


[eekkkk REINITAILIZE POST-THRESHOLD ***%%%/ 
J RRR RRR RII III IKI III III IIIT IIIA IIIT RRR TIA KIKI KA / 


/* This function will reinitialize the image after thresholding to */ 
/* the original image. a 


void thres_reinit() 


( 


char comment([(200}; 

INT PAR *par_ ptr; 

INT SIZE *size_ ptr; 

par_ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
Size _ptr=(INT_SIZE *)&image size;/* and image and window sizes*/ 


select_mem(MEM_B); /* select memory B x/ 


/* Read original image from temporary file */ 
readim(size ptr->a,size ptr->b,size ptr->maxx, 
Size ptr->maxy,"temp2", comment) ; 


display _mem(MEM_B) ; /* sy 
[BRR KERR K KKK KKK KKK KEKE KKK KKK KKK KKK KKK KK KEK KEKE KKK KEE KKKEKKKEK / 


[eekkkee SET LUT xe eeee/ 
J BKK RI IKI KKK II BR IITIIIIK I KKK KIKI TIKI I TIKIT KIKI TIKI KKK KKK KKK / 


/* This function will let you set the desired output lookup table */ 


void set_lut() 
( 
Mey bank. 
GFX_BOX *gbox; 
EVENT *ev; 
static char resp size[1}; 


526 


/* Forms box displayed for input */ 
Static FORM_ENTRY form[{)=( ("Enter bank number" ,resp_size,1)); 


/* Display forms box */ 
gbox=build_auto_box(FBOXO, (TEXT *) 0,2,fbox_init(form) ); 
ev=set_box_wrt_menu(JUSTIFY_START,0,0,gbox) ; 


if(ev->ascii_code == CANCEL BUTTON) 
{ clear_box{); 
Geturn: 
} 
bank=atoi(resp_size) ; /* bank number */ 
setlut (GREEN, bank) ; /* set LUT * / 
clear_box(); /* clear forms box */ 


JL RRR ERE K EKER REE KEKE KKK ERE KE KERR KEKE KEKE KEKE KEKE EKEKEREKKRER / 


/eeeeee STORE LUT eexeee/ 

J RRR ERE KR EEK KEKE KEKE EKER KEKE EEK EERE EKER KEEE KEKE ERE EKKKK KEKE KEKE KKEE / 
/* This function will store a desired LUT trnsformation in the frame*/ 
/* memory so that transformed values can be filtered, equalized, and*/ 
/* processed. x / 


void store lut() 


( 

int bank, lut{256}; 
itec,x,Y,pPpixarray(512},intens; 
INT_PAR *par_ ptr; 

INT_SIZE *size_ ptr; 

GFX_BOX *gbox; 

EVENT *ev; 

static char resp size({1]},resp_tol{1]); 


/* Forms box displayed for input */ 
static FORM_ENTRY form[{}=(({"Default values are:" ,(TEXT *) 0, 0}, 
{"x=0 y=0 dx=511 dy=511", (TEXT *)0, 0}, 
{"Use rectangle values?",resp tol, 1}, 
("Enter bank number",resp size,1},}; 


par ptr={INT_PAR *) &parameters; /* structures with parameters*/ 
size ptr=(INT_SIZE *)&image size; /* and image and window sizes*/ 


/* Display forms box */ 
Spex-bulid auto box{FBOX0, {TEXT *) 0,2,fbox_ init(form) ); 
ev=set_box_wrt_menu{JUSTIFY_START,0,0,gbox) ; 
if(ev->ascil_ code == CANCEL BUTTON) 

{ clear box{); 
return; 


) 


[RRR EEEEEEKEEKEE / 


bank=atoi({resp_sizZe) ; /* bank number */ 
ralut (GREEN, bank,0,256,lut); f/* read LUT x / 


/* Use default values? */ 
ie (recpetol(O) 2=) "y" ) {Size ptr=>initx=0;size ptr=>inity=0: 
Size ptr=>adx=511;size ptr=>dy=511; } 


/* Transform pixels and resave them in frame memory */ 


of 


for (y=0;y<=size ptr->dy;y+t) 


rhline(size_ptr->initx,size ptr->inity+ty,size_ ptr->dx,pixarray) ; 
for (x=0;x<=size_ ptr->dax;x++) 

{ 

intens=pixarray([x]; 

pixarray(x])=lut(intens); 


whline(size ptr->initx,size ptr->inityt+y,size_ ptr->dx,pixarray) ; 


} 


[RRKRKKKKKKKKKK KKK KKKKKKKKK KKK KKK KKK KKK KKK KKK KKK KKK KKK / 


Cclearvbox( /* clear forms box */ 


J RRR KRKKKKKKKKK KEK KK KKK KKK KKK KKK KK KK KKK KKK KK KKK KAKKKKKAKKAKKK KK KK / 


[keke HISTOGRAM ***4*/ 
RIO OIC a a toto / 


/* This function computes the histogram for a selected area and x/ 
/* @Aisplay the histogram on the computer monitor. The menu program */ 
/* is continued by pressing any key. a7 


void histo_gram() 
{ 
int c,m,view_hand,bad_ view; 
long histvals(256); 
float value[256]; 
PILE o*f aper, 
Char fname([(]="paul"; 
int 1,mode; 
chartenv env; 
Char far *glabel[7]= 
{ Hom WSO "100" "150" “Zool 2 So. " - 
Char far *graylvl[(256]; 
INT PAR *par ptr; 
INT SIZE *sizenper, 
GFX _ BOX *gbox; 
EVENT *ev; 
static char resp var{1]; 


/* Forms box displayed for input */ 

static FORM ENTRY form(]={{"Default values are:" ,(TEXT *) 0, 0}, 
{"y=40 y=45 dx=410) dy=405.", (TEXT 4)rcmcee 

{"Use rectangle values?",resp var, 1},}°; 


par _ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
Size_ptr=(INT_SIZE *)&image size; /* and image and window sizes*/ 


/* Display forms box */ 
gbox=bulld auto box(FBOX0O, (TEXT *) 0,2, fbox init(form)); 
ev=set_box_wrt_menu(JUSTIFY_START,0,0,gbox) ; 


1f(ev->ascii_code == CANCEL BUTTON) 

{ clear box(); J RRR KK KK IKK KKK KR KK KK / 
clear_menus(); /* If cancel button:clear box and menu, */ 
kee (il) 8 /* Gecouple keyboard interrupt, reset */ 
SCREEN (0); /* screen mode, and return to main. x / 
return; [ REKKEEKKEKKEKKKKKKEKKARERKAKEKREKEKERERER / 


} 


[REKERKKKKKEKRKEKKKKKKKEE / 
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/* Use default values? */ — 
if(resp_var(0] != 'y') (size ptr->initx=45;size_ptr->inity=45; 
size ptr->dx=410;size_ ptr->dy=405; } 


/* Compute histogram values */ 
histogram(size_ptr->initx,size_ptr->inity, | 
size_ptr->dx,size_ptr->dy,1,1,0,histvals) ; 


Clear box(); /* clear forms box ial 
for (m=0;m<=255;m++) /* Convert histogram x / 
{ /* values to float for */ 
value([m}] = ((float)histvals{m]); /* display. Ay 
} 
elear menus (); /* Clear menu system for */ 
halt_q(); /* display. Decouple key- */ 
SCREEN (0) ; /* board and reset screen */ 
mode=_VRES16COLOR; /* mode. Display uses x/ 
while( ! setvideomode (mode) ) /* microsoft graphics */ 
mode--; 7* fLuctions. oe 
i1f( mode== _TEXTMONO) 
return; 


/* Microsoft setup for display */ 
Beg initchart()> 
_pg_defaultchart(&env, PG _COLUMNCHART, PG_PLAINBARS) ; 


for (1=0;1<256; i++) { Vict ot tokeheketohahetotehetetetotehohetetehehetetetehetetehelelel 

graylvl{i] = glabel[(6]; /* Intervals for graph x / 

) a ws 
graylvl(0]} = glabel(0); /* a 
graylv1l(50} = glabel(1]; /* ay 
graylvl[(100] = glabel([(2)]; j ee 
graylvl[150] = glabel(3); /* sh 
graylvl[200] = glabel(4); Vas os 
graylv1[250} = glabel(5}; [RRR RII IKI KK KK RTT KK KR RK / 


strcpy(env.maintitle.title,"Histogram of Image") ; /** ee eK RR KKK KK / 


env.maintitle.titlecolor = 6; ye Graph at 
env.maintitle.justify = _PG RIGHT; /* labels */ 
Serepy (env.subtitle.title," '), /* ay 
env.subtitle.titlecolor = 6; /* iy 
env.subtitle.justify = _PG_ RIGHT; fo “es 
strcpy(env.yaxis.axistitle.title,"Intensity") ; /* aA 
strcpy(env.xaxis.axistitle.title,"Gray Level"); /* A 
env.chartwindow.border = FALSE; [RRA KEEKEKEK / 
if( pg _chart( &env,graylvl,value, 256) ) [J RRRRKK KKK KKK / 
{ ye Draw i A 
BOURUCH OG Error: can't draw chart"); /* graph “es 
return; [RR KK KR KR RK / 
} 
else 
getch(); /* Strike any key to continue */ 


} 


[KKH KKK KKK KKK KKK KKK KKK KKK KK KKK KKK KK KKK KR KKK RR OK RRR / 


o°9 


/xkeeee EQUALIZE ***#e*/ 
SJ BRK HK KEKE KERRI KIRK KKK KIKI IKK KEKE KHER KEEEKEKKE KKK KKKEK / 
/* This function performs histogram equalization on image. */ 
/* Equalization is based on default values or designated area. */ 


void histo _equalize() 


{ 

int bank; 

[INT UPAR *pareptr, 

INT_SIZE *size ptr; 

GFX_BOX *gbox; 

EVENT *ev; 

static char resp var[1],resp_tol{1]); 


/* Forms box displayed for input */ 
static FORM _ENTRY form[({]={{"Default values are:" ,(TEXT *)0, 0}, 
{"x=40 y=45 dx=410 dy=405.",(TEXT *) 0, O}, 
("Use rectangle values?",resp var, 1}, 
{"Which bank for LUT?",resp_ tol,1}}; 


par_ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
S1ize_ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


/* Display forms box */ 
gbox=bulild_ auto _box(FBOX0, (TEXT *) 0,2,fbox_init(form) ); 
ev=set_box_wrt_menu(JUSTIFY_START,0,0,gbox) ; 
1f(ev->ascii_code == CANCEL BUTTON) 

{ clear ibox(): 
return; 


} 


/* Use default values? */ 
if(resp_var[{0) !='y')(size_ptr->initx=45;size_ptr->inity=45; 
size_ptr->dx=410;size_ptr->dy=405; } 


bank=atoi(resp_ tol); /* Bank number */ 


/* Perform histogram equalization */ 
histeq(GREEN,bank,size ptr->initx,size ptr->inity, 
Size ptr->dx,size_ptr->dy) ; 


clear box(); /* Clear forms box */ 
} 


J BRK RHR EK RK RIKKI KI IK IK KKK IKI KIKI KKK KI KIRK KKH KEKE KEKE KKK / 


[reek KALMAN FILTER **%%%%/ 


J BRR RRR RRR RRR IKI RIKKI IKK KIKI HK KK KIKI KIKI KIKI KIKI KKH KEKE ARK K KKK / 
/* This function performs kalman filter operation on a single frame. */ 


/* Filtered image is displayed on video monitor. iy, 

TEXT *form3[]={"Image is being", /* Text displayed in */ 
"filtered on the", /* dialog box during */ 
"Video monitor"); Jr LL. LECr ANG - 7 


void snap_kalman() 
{ 
Int, x, yo plxarvay (sia. 
float p[512),k[512], errer, xela new, 
GFX _ BOX *gbox; 
EVENT *ev; 
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TNT PAR *par ptr; 
MNT SIZE *size ptr; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
size _ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


1=0; 
p(Oj=par_ptr->pinit*par ptr->var; /* initialize p */ 


/* Save image in temporary file for reinitialization */ 
Saveim(size_ptr->a,size ptr->b,size_ ptr->maxx, 
Size ptr->maxy,EIGHT BIT,"temp1"," "); 


/* calculate kalman gains and riccati equation */ 
while(i<=size ptr->size-2) 
{ 
k(iJ=p(ijJ/(p(i)+par_ptr->var) ; /* Kalman filter gain */ 
Butt. )=p[i)=-K(1)*p[ij+par_ptr->q; /* ricatti equation x / 


mouse_hide crsr(); 


/* Display dialog box */ 
gbox=build_auto_box( IMMEDIATE RETURN + DBOXO, (TEXT *) 0, 
OF GbOxei nit trorms ))):; 
ev=set box _wrt_menu(JUSTIFY_END,0,0,gbox) ; 


/* apply kalman filter to image */ 
for(y=O;y<=size ptr->dy;ytt) /* row loop */ 
{ 


Oe 


rhline(size ptr->initx,size ptr->inityt+ty,size_ptr->dx,pixarray) ; 
xOld=pixarray([(0); /* make intensity floating point */ 


for (x=0;x<=size_ptr->dx;x++) J* Comumm loop */ 
( 
xnew=xold+k[(ij]*(pixarray(x]-xold); /* kalman estimate x / 
error=(pixarray(x]-xnew)/sgqrt(p(ijJ+par_ptr->var);/* error */ 


Tee /*increment kalman gains */ 
if (fabs(error) >=par_ptr->tol) /* confidence interval */ 
{ 
xnew=pixarray(x]; /* reinitialize kalman filter */ 
i=0; 


pixarray(x]=0; 
} 
else 


{ 
bixartray ij) —2oo; 
J pixarray([x])=xnew; */ /* make estimate integer */ 


} 


xold=xnew; /* estimate is old value for next 
iteration */ 


} 


/* display filtered image */ 
Wihline(Size ptr-sinitx,size ptr-sinitysy,size ptr--dx,pixarray) ; 


east 


) 
Cclear_box(); 
mouse_show_crsr() ; 


[BRR KKK KEKE REE RK KK IKK IKKE KKK EERE KHER HR KEKE KEK / 


[keke TRACK tke eke / 
J BRIA IIH KKK IK ITT KI III IIB IIB IID TIAA IT II II IKI BIT I KI IT KT IK IITA / 


/* This function will track an object using the center of mass x / 
/* technique with a predictor algorithm, a moving average threshold */ 
/* range, and a lost object calculation included. x / 


void track_predict() 


int box_size,target,x,y,pixarray([55]; 

int bl,kjecenter,m3,m4,cecral2|- 

int target_min,target_max; 

float sumx,sumy,sumt,target_sum,center_x,center_y; 
float coord predict[(2],vel[(2],count,sum; 

float kgain[20}[(2]; 


kalman_gain(kgain) ; /* Compute kalman gains for predictor */ 


[kkkkkkkkKK Toop until both mouse buttons are pressed *#*#k kkk RK */ 
while(!(mouse_state.buttons & 0x01)) 


{ 

grab(-1); /* Real-time image */ 
real _mouse(coord) ; /* designate object */ 
box_size=47; 

target_sum=0.0; 


For(y-coord( 1)-—2; y<coorail) +3. 4) J BR RR KK / 


{ 


for (x=coord(0)]-2;x<coord(0j]+3;x++) 


{ /* compute mean x/ 
target _sumt+=rpixel (x,y); /* intensity value */ 
} 

target=(target sum/25)+.5; [RRR KRRKKKKK RR RK KKK / 


center=box_size/2.0; 
bl=box _size-2; 


k=0; 

coord_predict[0]=coord[0}; /* initialize object */ 
coord predict[(1]=coord(1); J* location: ise! 
vel(0j=0.0; 

vel(1)=0.0; 


rectangle(coord([0)-center,coord[(1]-center, 
box _size,box_size,0); 


target_min=target-4; /* set threshold range */ 
target _max=targett+4; 


[xkkkkk*k Loop until right mouse button is pressed *****xx*/ 
while(! (mouse _state.buttons & 0x02)) 


{ 

snap(WAIT) ; 
sumx=0.0;sumy=0.0; 
sumt=0.0;count=0.0; 
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for (y=1;y<=bl;yt+=4) GGwereop */ 


( 
rhline(coord[(0}-center,coord(1]-centerty, 
box _size,pixarray) ; 


for (x=1;x<=bl;x+=4) 7 seolunn oop * / 


( 
if((pixarray[(x]>=target_min) && 


(pixarray(x])<=target_ max) ) /* Object? */ 
{ 
sumt+=pixarray [x]; [RRR KKEKKKKK KKK / 
SUMX+=X; /* Parameters used to*/ 
sumy+=y; /* calculate center */ 
COunt++; /* of mass. x / 
} J RRRKEKEKKEKEEKEKKEKEEKKEKE / 
else ({sum+=pixarray[x];} 
} 
} 
1f (count !=0.0) ¢ [III TI ITI TRI I / 
center x=(sumx/count) ; /* Compute center of */ 
center _y=(sumy/count) ; /* mass and moving avs 
target _min=(sumt/count)-3.5; /* average. * / 


target _max=(sumt/count) +4.5; [RREERKKKKKK KKK KR KK KKK / 


else{ 
center x=centert+l1; JERR KEKKEKKEKEEKKEKKKK EE / 
center_y=center+1; /* Compute lost object*/ 
target _sum=0.0; /* mean value. wyA 
for(y—coord|1)=4;yscoord[ 1 )4+5;y++) 
( 
for (x=Ccoord(0)=—4;x<coord([0]+5;x++) 
{ 
target _sum+=rpixel (x,y); 
} 
} 
tCargec—(targect sum/81)+.5; 
target _min=target-4; 
target_max=target+4; 
} [RRR RKEKKKEKRKEKEKKEKK KE / 


{/*** Predictor ***/ 


coord predict(0)+=.6*vel(0]+kgain[(k](0)*(center x+l-center) ;: 
coord predict(1)+=.6*vel(1)+kgain[k](0])*(center_y+1l-center) ; 


vel(0})+=kgain[(k](1]*(center_x+1l-center) ; 
vel(1)+=kgain[(k])[(1]*(center_ y+l-center) ; 


K++; /* increment gains x / 
if (k>19) /* reinitialize gains */ 
k=0; 


coord(0)=coord_predict(0)]+.5; /* change predicted 


GQOrd| it) =coord predict 1]+25; /* value to integer. 


rectangle(coord(0]-center,coord({1)-center, 
box_size,box_size,0); /* Center window 
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x / 


x / 


mouse get _crsr(); /* button pressed? */ 
) 


[RRKKKKKKKKKKKkKkkKKkK End track loop KAKA KAKA RRR RAK KK KKK / 


mouse get_crsr(); /* button pressed? x77 


[RaKKKKKKKKKKKKKKKKEKK End FUNCTION LOOP FEHKHKKAKHAKKKKKKEK KKK KKK / 


J BRR KKK HK KKK KKK KK KKK KKK KKK KEKE KKK KEE KEKE KEKE KKEKKEKKKKKKEK KKK KEK / 


/*kkkk* KALMAN EDGE DETECTOR *#**%%/ 
[RK KK KKK KKK KKK KK KKK KKK KKK KK AK KKK KEKE KK KEKEKEKEKKEKKK KKK AKKE KEKE / 
/* This function will track an object using a Kalman filter edge x / 
/* detector. A predictor for object location is also included. x / 


void kalman_edge() 
( 
int box_size,i,x,y,pixarray(512]; 
int bl,k,center,m3,m4,coord([2); 
float sumx,sumy,center_x,center_y; 
float coord predict(2),vel[2),count,sum; 
float kgain(20}[(2],kal_gain_pos[(20),kal_gain_vel[20]; 
float p[65},ks_gain[65]; 
float error, xold,xnew,xhat,yhat,velx,vely; 


kKalman_gain(kgain) ; /* Kalman gains for predictor */ 
kalman_scalar(ks_gain,p); /* Kalman gains for filtering */ 


[kxkkkkekkk Loop until both mouse buttons are pressed **kkkekeKK/ 
while(! (mouse _ state.buttons & 0x01) ) 

{ 

grab 1). 

real _mouse(coorda) ; /* display cursor for designation */ 


rect (coord[(0},coord[1],kgain,ks_gain,p); /* track function*/ 
) 


JL RRR KKK KKK KKK KEK KKK KKK KKK EK KEK KKK KEK KKK KEKE KKKEKKKKEK KKK KK KK KKK KE / 


J RRR RK RRR KR KKK KKK KKK KR KKK EK KKK KEK KEK KKK ERK KEKE KKK KKK KK KKK KARE KKK / 


[RxKKK TRACK ALGORITHM RKEKKEK / 


[RRR RRR RAKHI KK KEK KI KKK KKK KKK KKK RR KKK KEKE KKK ARK KKK EK KKK KKK KKK KKK KKK / 
/* This function uses a Kalman filter to track an object. */ 


rect (int a,intyb, float kgain[j(2),flleat KkKonaarni inc loatapillD 
{ 
int m1,m2,bx,by,target ,x,y,pixartay==|ool- 
int bxx,k,xs,ys,m3,m4,i,pixarray_y[65],}; 
float sumx,sumy,xo,yo,tol,var,xold_x,xnew_x,error_ x; 
float xhat,yhat,velx,vely,xtemp, ytemp, count, xold_y,xnew_y,error_y; 
INT PARKS? Dalepen, 
INT SIZE *sSizesper, 


par_ptr=(INT_PAR *) &parameters; f/* structures with parameters*/ 
Size ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 
bx=63; /* window size */ 

by=62?; 
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XS=bDx/2.0; /* window center */ 
ys=by/2.0; 

k=0; J sanitial conditions.) */ 
xhat=a; 

yhat=b; 

velx=0.0; 

vely=0.0; 

bxx=bx-2; 


eee * *) LOOp until right button 1s depressed *4*********x** / 
while(!(mouse_state.buttons & 0x02)) 
{ 
snap(WAIT) ; /* snap single frame */ 
rectangle(a-xs,b-ys,bx,by,0); /* center window x / 
Sumx=0.0;sumy=0.0; 
count=0.0; 
for (y=1; y<=bxx;y=y+6) /* row loop */ 
{ 
1=0; 
J=0; 
rhline(a-xs,b-ys+y,bx,pixarray_ x) ; 
xOld_x=pixarray_x[{1]; 


for (x=1;x<=bxx;x=x+4) /* column loop */ 
{ 
/* filter image */ 


xnew_x=xold_ x+ks_gain{i])*(pixarray_x[x]-xold_x); 
/* compute error */ 


error_x=(pixarray x[x]-xnew_x)/sqrt(p[i]+par_ptr->var) ; 


oo 


if(fabs(error_x)>=par_ptr->tol) /* edge? */ 
( 
xnew_xX=plxarray x(x]; /* reinitialize Kalman */ 
1=0; 
SUMX+=X} 
sumy+=y; 
Counc++ ; 


} 


xOld_x=xnew_x; 
} VrSend corumn, Loop */ 


} /* end row loop x / 
if (count !=0.0) /* edge detected? */ 
{ 
xo=(sumx/count) ; /* compute center */ 
yo=(sumy/count) ; 
} 
else 
{ 
XO=XS;} 
yo=ys; 
} 
if (k=0) /* velocity boost for first calculation *, 


{ 
velx=(xo-xs) *1.5; 
vely=(yo-ys) *1.5; 
} 
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f 


xtemp=xnhat+.6*velx+kgain[(k)[(0)*(xo-xs) ; /* predictor */ 
ytemp=yhat+. 6*vely+kgain(k](0]*(yo-ys) ; 
velx+=kgain(k]{1]*(xo-xs) ; 

velyt+=kgain(k][{1})*(yo-ys) ; 

xhat=xtemp; 

yhat=ytemp; 


k++; 

‘if (k>18) /* reset predictor gains */ 
k=0; 

a=xhat+.5; /* integers */ 

b=yhat+.5; 


mouse_get_crsr(); 


mouse_get_crsr(); 


J BRR RRR / 


[xxekk*k KUTONOMOUS NAVIGATION **2%%%%/ 


J BRR RRR / 
/* This function will track a road edge using a Kalman filter x/ 


void auto_nav() 
( 
int box _size,i,x,y,pixarray(512]; 
int bl,k,center,m3,m4,coord{2); 
float sumx,sumy,center_x,center_y; 
float coord_predict(2],vel[2],count,sum; 
float kgain({20)(2),kal_gain_pos[(20),kal_gain_vel(20]; 
float p(65),ks_gain[(65); 
float error,xold,xnew,xhat,yhat,velx,vely; 


Kalman_gain(kKgain) ; /* Kalman gains for predictor */ 
kalman_scalar(Ks_gain,p); /* Kalman gians for filtering */ 


[eaekkakkkkkekke Loop until both buttons are depressed *#e kaka keke k / 
while(!(mouse_state.buttons & 0x01)) 


{ 

grab(-1); 

real _mouse(coord) ; /* cursor for designation */ 
rectl(coord(0),coord{1),kgain,ks_gain,p); /* track */ 


JS REAR ARERR EERE EEEEEKEKE / 


J BH HHH IRR RIE KIER EEER ARERR REKKKER KKK KR / 


/xeeeeek TRACK ALGORITHM 2 *#8848/ 
J He a RIKI HRI KHAKI IRIKKRII IKK KR KK I KK I RE R / 
/* This function tracks a road edge horizontally using a Kalman * / 
/* filter. A predictor is included for centering. */ 


rectl(int a,int b,float kgain{)({2),float Ks_gain[(],float p{}) 
( 
int ml,m2,bx,by,target,x,y,pixarray_x(65); 
int bxx,byy,k,xs,ys,m3,m4,1,pixarray_y(65),j; 
float sumx,sumy,xo,yo,tol,var,xold_x,xnew_x,error; 
float xhat,yhat,velx,vely,xtemp, ytemp, count; 
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INT_PAR *par ptr; 
INT SIZE *sSize ptr; 


par_ptr=(INT_PAR *) &parameters; ye 
Size_ptr=(INT_SIZE *)&image_size; /* 


bx=43; /* 
by=45; 

xXS=bx/2.0; /* 
ys=by/2.0; 

k=0; /* 
xhat=a; 

velx=0.0; 

byy=by-2; 

bxx=bx-2; 


structures with parameters*/ 
and image and window sizes*/ 


Window size */ 


window center */ 


intdtial conditions */ 


[eekKKKKKK Loop until right mouse button is depressed *#* eke eRKK/ 


while(! (mouse _state.buttons & 0x02)) 
{ 
snap(WAIT) ; 
rectangle(a-xs,b-ys,bx,by,0); 
Sumx=0.0;sumy=0.0; 
count=0.0; 


for (y=liy<=byyiy=y+6) 
{ 
1=0; 
J=0; 


/* snap single frame */ 
/* center window * / 


/* row loop */ 


rhline(a-xs,b-yst+y,bx,pixarray_ x); 


xold_ x=pixarray_x(1); 


for (x=1;x<=bDxx; xX=x+4) 


( 


/* filter image */ 


/* column loop */ 


xnew_x=xold_x+kKs_gain[{1]}*(pixarray_x[x]-xold_x); 
f= SOIOn  -/ 
error=(pixarray_x[x]-xnew_x)/sqrt(p[{i}+par_ptr->var) ; 


i++; 


if (fabs (error) >=par_ptr->tol) 


xnew_x=pixarray_x[x]; 


1=0; 
SUMX+=X; 
count++; 
} 
xold_ x=xnew_x; 
} 
} 


if (count!=0.0) 
{ 
xo=(Sumx/count) ; 
} 

else 
{ 
XO=XS; 


} 


if (kK=0) ibis 


OF 


/* edge? */ 


/* reset filter gains */ 


hiss 
/* 


/* 
/* 


end column loap */ 
end row loop */ 


edge detected? */ 


COompuce Center */ 


initial velocity boost */ 


{ 
velx=(xo-xs) *1.5; 


) 


xtemp=xhat+.6*velx+kgain[k}[0]*(xo-xs); /* predictor */ 
velx+=kgain[k}[1]}*(xo-xs) ; 

xhat=xtemp; 

k++; 


if (k>18) /* reset predictor gains */ 
k=0; 


a=xXhat+.5; 
mouse get _crsr(); 


) 


mouse get crsr(); 


[RR RRRRK EKER KKKKKKE KEKE KEKE ERE KK KKK KKK KKK KKK KEKE KKK KKKE KKK KKK KEKE EEE KEKE / 


/ekkkkk THRESHOLD ***% ex / 
[RRR KERR EK EERE RK KK EKER KKK KK KKK KK KKK KKK KKEKK KEK KKEKKKEKEKKEKKEKEEK KEKE KEKEEE / 
/* This function performs a threshold operation on a selected area */ 
/* of an image. */ 


void thres_hold() 
{ 
int thres,c,y,xX,pixarray[512],view_hand; 
ENT PAR *par ptr; 
INT SIZE *size_ ptr; 
GFX_BOX *gbox; 
EVENT *ev; 
static char resp var{3],resp_tol[{1]; 


/* Forms box displayed for input */ 
static FORM_ENTRY form[]=({"Enter threshold value" ,resp var,3}, 
{"Default values are:" ,(TEXT *) 0, O}, 
{"x=40 y=45 dx=410 dy=405.", (TEXT *}omee 
("Use rectangle values?",resp tol, 1},}; 


par_ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
size ptr=(INT SIZE *)&image size;/* and image and window sizes*/ 


/* Display forms box */ 
gbox=build auto box(FBOXO, (TEXT *) 0,2,fbox_init(form) ); 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 
if(ev->ascii_code == CANCEL BUTTON) 

{ clear box); 
return; 


} 


/* save image temporary file for reinitialization */ 
saveim(size_ ptr~>a,size ptr->b,size_ ptr->maxx, 
Size ptr=>maxy,EIGHT Bin, tempz yee): 


/* Use default values? */ 
if(resp tol(0}) != ‘y'){size_ptr->initx=0;size_ptr->inity=0; 
size _ptr->dx=5ll;size_ ptr->dy=511;)}) 


thres=atol(resp var); 
for(y=O;y<=size_ptr->dy;y+t+) /* row loop */ 
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rhline(size_ptr->initx,size ptr=->inityty, 
size ptr->dx,pixarray) ; 


for (x=0;x<=size_ ptr->dx;x++) /* column loop */ 
{ 
if (pixarray(x])<=thres) {pixarray(x]=50;} /* threshold */ 
else{pixarray(x]=200;)} 


} 
whline(size_ptr->initx,size ptr->inityty, 
Size_ptr->dx,pixarray) ; 


clear _box(); /* clear forms box */ 


} 


J BERK K KKK KEKE KKK KEE KKK KEKE KKK KK KKK KKK KKKEKKERKEKKEKKEKKKEEKKK KK KK KKK KK / 


/**xx*e*k*k TARGET AREA *#& eke / 
[RR RRR KEK KEKE KEK KKK KKK KEKE KEKE KEKE KKK KEE KEKE KEKE KEKE KEK KEEKEKKEK KKK KKK EK / 
/* This function will allow you to designate a area for processing */ 
/* or analysis by placing a cursor on the video monitor. Pressing */ 
/* the left mouse button will cause a window to appear that can be */ 
/* increased or decreased in size. aa 


TEXT *forml1(J=("To change rectangle size use" , /* forms box info */ 
Wii's to inerease size", 
"and 'D' to decrease size!", 
Mtyper's* Co stop'')> 


TEXT *form2[]={"Cursor 1s on the", /* forms box info */ 
"video monitor!"); 


void snap_rect() 
int c,array([2]; 
char comment[(200]; 
GFX BOX *gbox; 
EVENT *ev; 
INT PAR *par_ ptr; 
PNT SIZE *Size ptr; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
Size ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


display _mem(MEM_B); /* display original image x / 
select mem(MEM B); 


/* save image in temporary file for adjusting window size */ 
Saveim(size ptr->a,size_ptr->b,size_ptr->maxx, 
Size _ptr->maxy,EIGHT_BIT,"temp"," "); 
select _mem(MEM_A) ; 


readim(size ptr->a,size_ptr->b,size ptr->maxx,size ptr->maxy, 
"temp", comment) ; /* read image into memory A */ 


select _mem(MEM_B); 


mouse hide crsr(); 
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/* Display forms box */ 
gbox=build_auto_box( IMMEDIATE_RETURN + DBOXO, (TEXT *) 0, 
0,dbox_init(form2)); 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 


nonreal_mouse(array) ; /* Display cursor on video monitor */ 
Clear_box(); /* clear forms box */ 
mouse_show_crsr(); 


size ptr->initx=array(0)]-32; /* window location */ 
size _ptr->inity=array(1)]-32; 
size ptr->dx=64; 
size_ptr->dy=64; 
rectangle(size ptr->initx,size_ptr->inity, 
size _ptr->dx,size_ptr->dy,0); /* draw window */ 


/* Display forms box */ 
gbox=build_auto_box( DBOX0, (TEXT *) 0,2,dbox_init(forml)); 
gbox->buttons = &select_prect_button; 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 
if (ev) 
{ 


[keRKKKKKKKKKK LOOD until OK is selected *xxxenrkakkkk ake / 
while(ev->ascii_code) 
( 
erase(); /* erase old window */ 
switch(ev->ascii_code) 
( 
case REC_INC: /* increase window size */ 
if(((size_ptr->dx)+(size_ptr->initx) +5>490) 
|| ((size_ptr->initx) -5<20) ) 
break; 
else if(((size_ptr->dy)+(size_ptr->inity)+5>490) 
|| ((size_ptr->inity) -5<20) ) 
break; /* limit window to video monitor */ 
else 
((size_ptr->dx) +=10; 
(size _ptr->dy) +=10; 
(size _ptr->inity) -=5; 
(size _ptr->initx) -=5; ) 
break; 
case REC DEC: /* decrease window size */ 
(size_ptr->dx) -=10; 
(size_ptr->dy) -=10; 
(size_ptr->initx) +=5; 
(size_ptr->inity) +=5; 
if(size_ptr->dx<10) 
{size ptr->dx=10; 
size_ptr->dy=10; } 
break; 


) 


rectangle(size_ptr->initx,size ptr->inity, 
Ssize_ptr->dx,size ptr->dy,0); /* draw window */ 


ev=revisit_box(); /* get new button designation */ 


} 
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erase(); /* Clear window */ 


) 


clear_box(); /* clear forms box */ 


J BRK RIK IKK IK KKK KK KKK KK KKK KKK KK KI KKK KKK KKK KKK KKK RIKER KI KKK KKK KK KK / 


/***kk** COVARIANCE P tktke#/ 
J RRR KKKRKKRK KKK KEK KEKE KKK KKEKEEKKEKKKKK KKK KK KKK KKK KKK / 


/* This function allows you to change the covariance P. 1 


wed init p() 
{ 
INT PAR *par_ ptr; 
INT SIZE *size ptr; 
GFX_BOX *gbox; 
EVENT *ev; 
Static char resp var([6}; 


/* Forms box displayed for input */ 
Static FORM_ENTRY form[]=({ ("Enter new P factor:",resp var,6}}; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
Size_ptr=(INT_SIZE *)&image_ size; /* and image and window sizes*/ 


/* Display forms box */ 
ebox—pDudild auto box(FBOXO, (TEXT *) 0,2, fbox init( form) )-; 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 


if(ev->ascii_code == CANCEL BUTTON) 
{ clear_box(); 
return; } 
par_ptr->pinit=atof(resp var); /* change value */ 
Clear_box(); /* clear forms box */ 


J RRR KKK KKK KKK KKK KKK KKK IKK KKK KKK KK KK KIRKE KEKE KKEKK KKK KEKK KKK KKK KK KK / 


{/eekkk* COVARIANCE Q #k eke / 


[RRR KEKKEKREEE KEKE KEKKEKEK KKK KEKE EEE EEE EKER KER EEE KEKE KEEKEK KK KK KK / 
/* This function allows you to change the covariance Q. x / 


wera init q() 
{ 
MNT PAK “par ptr; 
INT_SIZE *size ptr; 
GFX_BOX *gbox; 
EVENT *ev; 
static char resp var[(6]}; 


/* forms box for input */ 
Static FORM_ENTRY form[(]=( ("Enter new Q factor:",resp var,6}}; 


par ptr—(INT PAR *) &parameters; /* structures with parameters*/ 
size ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


/* Display forms box */ 
Gbox=buila auto box(FBOX0, (TEXT *) 0,2,fbox init(form) ); 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 
if(ev->ascii_code == CANCEL BUTTON) 

{ clear_box(); 
return; } 
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par_ptr->q=atof (resp var); /* change value */ 
Clear_box();} /* clear forms box */ 


} 


[BK I KKK IK KK KKK KKK KK KKK KK IKK IKK KKK IKKE KKKKK KKK KKK KEKKKK KK / 


/**k*** ERROR TOLERANCE ***%%%/ 
[RRR KKK KIKI KK KKK KEK KEKE KKK KKK KKK KKK KEKE KK KKK KKK KK KK KKK KE / 


/* This function allows you to change the error tolerance. ay 


void tolerance () 
{ 
INT_PAR *par_ ptr; 
INT_SIZE *size ptr; 
GFX BOX *gbox; 
EVENT *ev; 
static char resp var[6]; 


/* Forms box for input */ 
static FORM_ENTRY form[]={ {"Enter new tolerance:",resp var,6}}; 


par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
size_ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 


/* Display forms box */ 
gbox=build auto _box(FBOX0, (TEXT *) 0,2, fbox_init(form)); 
ev=set_box_wrt_menu(JUSTIFY_END,0,0,gbox) ; 


if (ev->ascii_code == CANCEL BUTTON) 
{ clear_box(); 
return; } 
par_ptr->tol=atof (resp var); /* change value */ 
Clear _ box(); /* clear box x / 


[RRR KKK KK KKK KKK KKK KKK KKK KKK KKK KKK KKK KKK KKK HEE KKK REE KEKE KKK KEKE / 


/e*ekkkk COVARIANCE R kekeke/ 
JR RRR RII KIT KK KKK KKK KK REE KKK EKER RK RR RK / 


/* This function allows you to change the covariance R. */ 


void variance() 
( 
UNT PAR *par ptr, 
ENT SIZE *size ptr; 
GFX BOX *gbox; 
EVENT *ev; 
static char resp _var[6]; 


/* Forms box for input */ 
static FORM_ENTRY form[)=({ ("Enter new R value:",resp var,6}}; 


par _ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
size ptr=(INT_SIZE *)&image_ size; /* and image and window sizes*/ 


/* Display forms box */ 
gbox=build_auto_box(FBOX0, (TEXT *) 0,2,fbox_init(form)); 
ev=set_ box wrt_menu(JUSTIFY_END,0,0,gbox) ; 
if(ev->ascii_ code == CANCEL BUTTON) 

{ clear box(); 
return; } 


eZ 


par_ptr->var=atoi(resp var); /* change value */ 
clear_box(); ye clears rorms box  */ 


J BR KK KK KKK KKK KK KK KK KK KK KKK KK KK KI KK KKK KKK IKK IO IO KK a KI IK tO / 


/****%** NONREAL MOUSE ****4%/ 
[BKK KKK KKK KKK KKK KKK KKK KKK KK KKK KK KKK KKK KR KK IK / 


/* This function displays a cursor on the video monitor for ny 
/* designation of a target area. Press the left mouse button to * / 
/* designate target. */ 


void nonreal_mouse(int array[]) 
{ 
intedrmmayl{9)],anray2{9),mx,my; 
mouse state.x=256; /* center cursor on video monitor */ 
mouse state. y=256; 
mouse Set crsr(256,256) ; 


[RRR KK RR KR RK LOOP until button is depressed *k*e eee eek / 
while(! (mouse _state.buttons) ) 
{ 
mouse get _crsr(); /* read mouse location */ 
mx=mouse_state.x; 
my=mouse_ state.y; 


rhline(mx-4,my,9,arrayl); /* read pixel values x / 
rvline(mx,my-4,9,array2) ; prtor ENrsor focation */ 
clmeline(mx—4,my,mxX+4, my 0) ; /* draw cursor */ 


clr _line(mx,my-4,mx,my+4,0); 


whline(mx-4,my,9,arrayl) ; /* write over cursor */ 
wvline(mx,my-4,9,array2) ; 
) 
array[0Oj=mx; /* return final location */ 
array[(lj=my; 


[RRR KKK KKK KK KKK KK KK KKK KKK KK KKK KKK KKK KKK KKK KKK KKK KKK KKK KK KK KK KK KK / 


[*kkk*k* ERASE kkk kkk / 
JRO III IOI IO III TOO RK kk / 


/* This function reads pixel values from one memory to write over * / 
/* the window drawn on the monitor so that the window size can be x 
/* changed. wy 


void erase() 
{ 
Paice dasa vltoden array. (ol2)],array3{/512],array4([512); 
INT PAR *par ptr; 
ENT SIZE *Size. ptr; 
par_ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
size ptr=(INT_SIZE *)&image_size;/* and image and window sizes*/ 


/* Read pixel values from memory A */ 

select_mem(MEM_A); 

Bine (size prer—--imitx,Size PtLr==inity, size ptr—->dx,array 1): 

Pietneisi 26 pttr=-i1nitx, (Size ptr--inity)+ (size ptr--dy), 
SizeupieG--ax,drray2) ; 

Eeinew= iZemmer=Imitx,Ssize ptr=sifity,size ptr--dy,array3) ; 
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rvline((size_ptr->initx)+(size_ptr->dx),size_ptr->inity, 
size _ptr->dy,array4) ; 


/* Write pixel values in memory B to remove window */ 

select_mem(MEM_ B); 

whline(size_ptr->initx,size ptr->inity,size_ptr->dx,arrayl) ; 

whline(size_ptr->initx, (size_ptr->inity)+(size_ptr->dy), 
size _ptr->dx,array2) ; 

wvline(size ptr->initx,size ptr->inity,size_ptr->dy,array3) ; 

wvline((size_ptr->initx)+(size_ptr->dx),size_ptr->inity, 

size_ptr->dy,array4) ; 


display _mem(MEM_B); 


J BR HH HRI KIKI IKI KIKI HEIKKI KKK IK IRE ER AKA EEK EE / 


/*xxxee REAL MOUSE *t# ete / 
hahaha hhckahghateheh che hahaietolehehalhekohahalatalahehahahehelekatatetetatehsteheletalaielelelaieheleteiohalslelelichaleleteislotelel | 
/* This function draws a cursor on the video monitor in real time. * 7 
/* The cursor is used to designate targets. 7 


void real_mouse(int array{)) 
( 
int mx,my; 
mouse state. x=256; /* center cursor */ 
mouse state.y=256; 
mouse_set crsr(256,256) ; 


[eaxkakakkkkkkkekkkeke Loop until left button is depressed *******/ 
while(! (mouse _state.buttons & 0x01)) 

{ 

mouse _ get _crsr(); /* read cursor location */ 

mMxA=mMouse State. x; 

my=mouse_state.y; 


clr line(mx-4,my,mx+4,my,0); /* draw cursor */ 

clr_line(mx,my-4,mx,my+4,0); 

) 
snap(WAIT) ; 
array({0)=mx; /* return cursor locativenme. 
array(lj=my; 


JR Te Re TT TT TKR TT TTT TTT TTT TK TT KIT KIT TTT TOK TOK TT TK IK IR TTR IK TK KR H / 


[reeeekk KALMAN GAIN *k kkk / 
JB RRR aK KIT RT TRI TI TKI KKK TTR IR IT TK IK TOI TTT TOT TOT TT TTT TIT IIE / 


/* This function computes the kalman gains for the predictor. ay / 


vold kalman_gain(float kgain(}{(2)) 
{ 
aie: 
float -f; 
float pkm(2)(2),c(2)(2), 
float ct[{2){2), ¢qf2u2 ra 
float phi[(2)(2)\jpheeie 
INT PAR @* par apti, 
INT_SIZE *size_ ptr; 
par_ptr=(INT_PAR *) &parameters; /* structures with parameters*/ 
Size_ptr=(INT_SIZE *)&image_size; /* and image and window sizes*/ 
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r=5.0;7t=.5; 
pkm(0)[{0)=20.0;pkm[(0)[1)}=20.0;pkm[{1}[(0}=20.0;pkm[{1)[{1]=20.0; 
c(0)(0)=1.0;c[0)[{1}=0;c[1}[(0}=0;c[1)[1}=0; 
phi(0)(0)=1.0;phi(0)(1)=t;phi[1)][0]=0;phi[{1}[{1]=1.0; 

€t[0] (0)]=1.0;ct(0}(1)=0;ct[1][0j=0;ct[{1}[(1]=0; 

q(0} (O)=.17q(0)(1)=0;q[1)(0}=0;q{1){1)=.1; 
phit(0](0)=1.0;phit(0}(1)=0;phit(1){0)=t;phit(1){1])=1.0; 


for (k=0;k<20;k++) 
( 
memult( 1, 2,2,¢,pkn,d): /* Kalman filter equations */ 
enue (ll. 2,),d,¢ct,e); 
f£=1.0/(e[0)[O0]+r); 
menust(2,2,1,pKm,ct, a) > 
g(0}(O)=f*d[(0)}[0); 
g({1)(0}=f*d[1)[(0); 
kgain(k}[(0}=f*d[(0)[0}; 
kgain({k})[{1])=f*d[(1}[(0}; 
Meme (2, 1 .2,9,C,a)3 
ad(0}[(0)=1-d(0}[0}; 
Sef j==d(0)(1); 
ere |--d{1)] (0); 
aq(ljf{lj=l-d[1){1}>; 
Mermule(2,2,2,a,pkm,pk) > 
Mem ti 2,2,2,pni,pk,é) ; 
meme 2,2,2,e,phit, pkm) ; 
pkm{0}(0}+=q{0}[0]; 
Ne ee 


J BRK HHH KKK KKK KKK KKK KKK KKK KKK KKK KKK KEKE KEK KKK KKK KEKE EKER KEKKE KKK KK KK / 


[RRR M MULT kkk kk* / 


[RII III IIR IO IOI IOI TOI TOTO I KOK / 


/* This function multiplies two 2x2 matrices used in the computation*/ 
/* of the predictor gains. 4 


Vomaem mult(int m,int n,int 1,float a[]{2},float b[{}[2],float c[{)[(2)) 
( 


me. Y,1,x? 
for (y=0;y<=m-1;y++) 


for(i=0;i<=1l-1;i++) 
( 
c{y}[1]=0; 
for (x=0;x<=n-1;x++) 
( 
ON ae 


} 


J BRR HHH KKK KKK KKK KEK KKK IKKE KKK KKK KKK KKK KKK KK KKK KKK KEKE KKK KKK KKK KKK / 


/xexkkk KALMAN SCALAR #%***%/ 
[ROI III III II TO III TO TO IOI IO a / 
/* This function computes the kalman gains for the edge detector. * / 
void kalman_scalar(float ksgain[], float p[}) 
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( 

Nhe eA te ie 

INT_PAR *par_ptr; 

INT_SIZE *size ptr; 

par ptr=(INT_PAR *)&parameters; /* structures with parameters*/ 
Size ptr=(INT_SIZE *)&image size;/* and image and window sizes*/ 


p(0)=(par_ptr->pinit)*(par_ptr->var); /* initial P[0] */ 

1=0; 

while(i<64) 
( | 
ksgain(ijJ=p(ij/(p(ij+(par_ptr->var) ); /* kalman equations */ 
p(++i)=p{i}-ksgain(i)*p[{i]+(par_ptr->q) ; 
} 


J BRK KK KKK IKK KKK KKH KIKI KEKE KKK KKK ERE KEKE KEKE EKA IKK KKK KKK KKK / 
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APPENDIX C 


abt tee eee PSCC CCE SESE CECE SESE ES ES SESE SSS. 


* 
* 
* 


* 


DATA FILE = 


* 


RHE KKKKKEK KKK KEKEKEKEKEEKKKERKKKAKK KEKE / 


#include "mer_menu.h" 


#define 
#define 
#define 
#define 
#define 


#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 


#define 
#define 


BOX DIM 


BUTTON DATA 
BUTTON DATA 
BUTTON DATA 
BUTTON DATA 


SUB_START 
READ START 
N_READ 
DSP_START 
N_DSP 
LUT_START 
N_LUT 
ANLY_ START 
N_ANLY 

PRO START 
N_ PRO 
PAR_START 
N_PAR 

QUIT START 
N_QUIT 


TEST_START 
N_TEST 


Zoot bcm, 


SHOW_CHECK MARK 
SC | CHECK _MARK_IS_ON 
DISABLE _CHOICE 

SUB_MENU_VECTOR 


ADD_BAR 


0 
0 
2 


/* 
/* 
/* 
/* 


Header file with all header 
files included plus special 
button definitions and list 
of all external functions. 


/* Define size of each pulldown menu */ 


READ START + N_READ 


4 


DSP TES TART Jt eN. DSP 


2 


LUT_START + N_LUT 


2 


ANLY_START + N_ANLY 


i. 


PRO_START + N_ PRO 


> 


PAR_START + N PAR 


0 


8 
3 


/* Define special button structures */ 
rect _increase=({'I',REC_ INC," INCREASE"); 
rect_decrease=({'D',REC_ DEC, "DECREASE" } ; 

EEG seOp—( 's', CANCEL BUITON, “SrOoP™); 
*rect_btns[j={&rect_increase, &rect_decrease, &rect_stop}; 


BUTTON _SET select_prect_button=({3,rect_btns,&std_btn_layout, 
Sbut ton ses, -1,2,.0, 0); 


PDM_ DEF 
( 


[RRR KKEKEKEEEKKEEE 


* 


* 


* MENU STRUCTURES * 


* 


* 


WHA KKK KKKK KEKE KKKEEKKEEEKE / 


choices{ } 
'R', "READ IMAGE"), 
'S', "SAVE IMAGE"), 
ey ; "CRAB" } ; 
'p! ; "SNAP"), 


7 


/* READ/SAVE */ 


J* TOES PEAY CHOICES 


aA 
ys 
wd 
a 4 


ay d 


1,0; 'F", “REINITEALIZE POST-FELTER”}, 


(0, 'T', “REINITIALIZE POST-THRESHOLD"), 

{O, ist “Sea LUT), f* LUT CHOICES @s7 

(0, 'A', "STORE LUT IN ARRAY"}, 

oF 'H', "HISTOGRAM"), /* ANALYSIS CHOICES */ 
(0, 'E', “EQUALIZE"), 

{O, 'K', "KALMAN FILTER"}, /* PROCESSING CHOICES */ 
707 'R', "TRACK" ), 

{ 07 'E', “KALMAN EDGE DETECTOR"}, 

i iely 'A', “AUTONOMOUS NAVIGATION"), 

en 'T' "THRESHOLD"}, 

(0; 'T', "TARGET AREA"), /* PARAMETER CHOICES */ 
(0, 'C', "COVARIANCE - P"), 

{0, 'Q', "COVARIANCE - Q"), 

{O, 'L', "ERROR TOLERANCE"}, 

C0; 'V', "COVARIANCE - R"} 


); 


/*eeeEe ROOK menu **eKR*/ 
ROOT_DEF pdm[(] = { {0, 'R', READ START,N_READ,"Read/Save",0, 0, 0, 0}, 
{O, 'D', DSP_START, N_DSP, "Display", 0, 0 


(0, 'L', LUT STARIEN LUT, "LUT 0, 0, 07 ee 

{O, 'A', ANLY START, N_ANLY,"Analysis",0, 0, 0, 0}, 
(O, 'P*', PRO START,N_PRO,"Processing", 0, 07 )OumGu 
{O, 'M', PAR_START, N PAR,"Parameters”,0, 0) )Oymuae 
{O, 'OQ', QUIT STARTS NROUIT, “Ouxvee O, 0, 0, “Ga: 


MENU_DEF menu = { n_arr_items(pdm, ROOT_DEF), (TEXT *)pdm, 
&root_layout, &basic cs, -1, JUSTIFY_START, 39an0ue 


MENU_DEF selections = ({ n_arr_items(choices, PDM_DEF),(TEXT *)choices, 
&pd_ layout, &basic_cs, -1, JUSTIFY_CENTER, @) @eiy 


ROOT_MENU root_menu = {0,&menu, &selections, (TEXT *}) 0, &root_bdim }; 


INT PAR parameters = )4 720.0701). 5 04 Oe 
INT_SIZE image size = (5127070) 5027 Se OM oie ole 
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#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#include 
#1include 
#include 


define 
#define 


U_UP 
U_DN 


APPEND tx: 


JL RRR KR KKK KKK KKK KKK KEKKKEKEEK 


* 
x 
x 


HEADER F ILE 


* 
* 
* 


RRR RR RK / 


<stdio.h> 
<math.h> 
<sealio.n- 
<conio.h> 
<ctype.h> 
<graph.h> 
<process.h> 
<time.h> 
<pgchart.h> 
Sctring. he 
<bios.h> 
Sexi Src." 
"menu.h" 
Taueo mnu.h" 
ice xpia. hi! 
—Sctatyp.h> 


0x0148 
O0x0150 


/* Microsoft header files 


Header 
Header 
Header 
Header 


/* Special definitions for 


file 
file 
file 
file 


w/ 
w/ 
W/ 
w/ 


GFX defs 


all the MENU defs 
externs for boxes 
frame board defs 


4 


BbuctoOnsS +7 


#define 
#define 


typedef 
typedef 


EVENT *set_ box(), 


REC_INC 1 
REC DEC 2 


/* Structures with parameters for image */ 


eitlets Pah (tloat Var, tol ,q,pinit;} INT PAR; 
Seruce. 1m {int Size, initx, inity, maxx: 


Incmmaxy ja ,e yao jay.} INT ISIZE; 


/* Define function type for box displays */ 
*set_box_wrt_menu(), *revisit_box(); 


GFX_BOX *build auto_box(); 


extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 
extern 


/* list of every external function used in menu */ 


vold 
void 
void 
void 
void 
void 
void 
void 
vold 
void 
vold 
void 


sethdw(),kalman_scalar(float ksgain{]}, float p[}); 
setdim(),erase(),kalman_edge(),auto_nav(); 

histo gram(), snap_it(), histo_equalize();: 

snap _rect(), snap_kalman(), thres_hold(); 
read_image(), save_image(), grab_it(); 

compress(), variance(), set _lut(), quit(); 

store lut(), reinit(), thres_reinit(); 

Mim cmp ined t(j. tolerance(), track(): 
track_predict(),nonreal_mouse(int array[2}); 

real mouse(int array[2}),kalman_gain(float kgain[20)[2)}); 
Moen, int mint 1,fleat a{2}(2},float bl2)}[2]; 
Plowere( 2 (2) ) 7 


GFX_BOX *bulild_auto_box(); 


EVENT 


*set_ box wrt_menu(); 


ROOT_MENU root_menu; 


BUTTON_SET select _prect_button, 


select _mem_button; 


INT _PAR parameters; 
INT _SIZE image_size; 
FONT 1iss_stl4; 

BON seme 29. 


MENU 


DEF selections; 


MOUSE STATE NEAR mouse_state; 
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